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1. Introduction 

The purpose of this survey is to explain an approach to the Atiyah-Floer 
conjecture via a new instanton Floer homology with Lagrangian boundary 
conditions. This is a joint project with Dietmar Salamon; see [Sa2] for an 
earlier exposition. This paper also provides a rough guide to the analysis of 
anti-self-dual instantons with Lagrangian boundary conditions in [W3, W4], 
which is the crucial ingredient of our approach. 

Atiyah [A] and Floer conjectured a natural isomorphism between the 
instanton Floer homology HF™***(y) of a homology 3-sphere Y and the 
symplectic Floer homology HF*'^™'' (TZs , Lh^ , Lh^ ) of a pair of Lagrangians 
Lho,Lh-^ in the symplectic moduli space T^s of flat SU(2)-connections, as- 
sociated to a Heegard splitting Y = Hq Us Hi. Both homologies were intro- 
duced by Floer [Fl, F2], but the symplectic Floer homology is not strictly 
defined in this case due to singularities of T^e. Taubes [T] proved that 
the Euler characteristics both agree with the Casson invariant of Y. The 
main task in identifying the homology groups is a comparison between the 
trajectories: pseudoholomorphic curves in TZj] with Lagrangian boundary 
conditions and anti-self-dual instantons on R x y (which has no boundary). 

The basic idea of our approach is to introduce a third Floer homology^ 
HF™'^*([0, 1] X Ti,Cho ^ ^H-i) whose trajectory equation couples the anti- 
self-duality equation on M x [0,1] x S with Lagrangian boundary conditions. 
We expect that two different degenerations of the metric on [0, 1] x S will 
give rise to isomorphisms that would prove the Atiyah-Floer conjecture ^ 

(1) HFr*([0, 1] X S, Ch, xCh,) = HFr*(ifo Us H^), 

(2) HFr*([0,l] X T.,Ch, X Ch,) = HFf (Te^ , i./fo , J • 



^This is a special case of the invariant HFi,"°'(y, £) introduced below for a 3-manifold 
Y with boundary and a Lagrangian submanifold C in the space of connections over dY . 

^There are moreover product structures on all three Floer homologies that should be 
intertwined by the isomorphisms, as sketched in [Sa2]. Our analytic setup should allow 
for their definition and identification, but we do not discuss this topic here. 



2 



KATRIN WEHRHEIM 



IAS PRINCETON 



This approach separates the difficulties: The first isomorphism is a purely 
gauge theoretic comparison between anti-self-dual instantons over domains 
with and without boundary. The second isomorphism requires a comparison 
between anti-self-dual instantons and pseudoholomorphic curves (both with 
Lagrangian boundary conditions), that would be a generalization of the 
adiabatic limit of Dostoglou-Salamon [DS], which they used to prove an 
analogon of the Atiyah-Floer conjecture for mapping tori. The mapping 
torus case does not involve boundary conditions. Moreover, the underlying 
bundle is nontrivial so that the moduli space of flat connections is smooth. 
In contrast, the Heegard splitting case deals with trivial bundles for which 
the moduli space TZs and its Lagrangian submanifolds are always singular. 

So the Atiyah-Floer conjecture poses as a first task (which we do not ap- 
proach here) the construction of a symplectic Floer homology for symplectic 
and Lagrangian manifolds with quotient singularities. In fact, the singular 
symplectic space TZs is the symplectic quotient (in the sense of Atiyah and 
Bott [AB]) of a Hamiltonian group action (the infinite dimensional gauge 
group) on an infinite dimensional symplectic space (the space of connections 
over a Riemann surface). In the case of a finite dimensional Hamiltonian 
group action with smooth and monotone symplectic quotient, Gaio and Sala- 
mon [GS] have identified the Gromov-Witten invariants of the symplectic 
quotient with new invariants arising from the symplectic vortex equations. 

The anti-self-duality equation on M x [0, 1] x E is the exact analogue of 
the symplectic vortex equations for TZ^. We will show in section 3 that 
the analytic behaviour of these trajectories of the new Floer homology is a 
mixture of local effects in the interior - as they are expected for anti-self- 
dual instantons - and surprising semiglobal effects near the boundary that 
resemble to the behaviour of pseudoholomorphic curves in TZs. This shows 
that the new Floer homology indeed provides a good interpolation between 
the two Floer homologies in the Atiyah-Floer conjecture. 

More generally, an instanton type Floer homology for 3-manifolds with 
boundary should naturally use Lagrangian boundary conditions. Fukaya 
[Fu] gives such a setup in the case of a nontrivial bundle: The anti-self- 
duality equation is coupled via a degeneration of the metric to the pseudo- 
holomorphic curve equation in the moduli space of flat connections (which 
is smooth in this case). Our new trajectory equation is a different setting 
that arises naturally from the Chern-Simons functional - the Morse function 
in the instanton Floer theory. It works in the gauge theoretic setting up to 
the boundary, which has the advantage that the Lagrangians are smooth 
Banach submanifolds of a symplectic Banach space, although the quotients 
might be singular. We thus give a setup for an instanton Floer homology 
HF™^*(Y, C) of a compact 3-manifold Y with boundary and a gauge invariant 
Lagrangian submanifold £ in the space of SU(2)-connections over dY. 



LAGRANGIAN BOUNDARY CONDITIONS FOR ASD INSTANTONS 3 

This program is carried through in [SW] for the case where L = Ch arises 
from a disjoint union of handle bodies H with boundary dH = dY = S such 
that Y Us H is a homology 3-sphere. We expect that the isomorphism (1) 
will be true in this more general setting, 

(1') RFr\Y,£H) = B.Fr\Y Us H). 

The assumption C = Ch is more of technical nature and is not required 
for the basic compactness in theorem 3.4. We also have an approach to 
removing this assumption in theorems 3.5 and 3.7, based on Mrowka's un- 
derstanding of the gauge group in borderline Sobolev cases. More essentially, 
we need the nontrivial flat connections on Y with boundary condition in C 
to be irreducible (i.e. to have discrete isotropy in the gauge group). For 
the same reason, the original instanton Floer homology is only defined for 
homology 3-spheres. Now starting from a Heegard splitting Hq Us Hi of a 
general closed 3-manifold, the irrcducibility could be achieved by perturbing 
the Lagrangians Chq and Chi ■ Thus the problem of reducible connections 
can be transferred to transversality questions in our new instanton Floer 
homology with Lagrangian boundary conditions. 

Section 2 provides an introduction to the gauge theoretic background. 
For the symplectic background we refer to [MSI]. We explain the Chern- 
Simons functional and the moment map picture of the gauge group ac- 
tion and give the setup for an instanton Floer homology HFlf^*(y, £) with 
Lagrangian boundary conditions. In section 3 we specialize to the case 
Y = [0, 1] X S and the Lagrangian submanifold Ch = Cho C-Hi arising 
from two handle bodies H = HqU Hi such that Hq U-£ Hi = Y Usue H 
is a homology 3-sphere. We give a detailed account of the new Floer 
homology HF|f®*([0, 1] x 'E,Cho ^ ^Hi), comparing its definition and the 
analytic properties of its trajectories to those of HF™'^*(i7o Us Hi) and 
HF^/"^'^{'}Zj:,Lhq,Lh'^) (what it would be if these quotients were smooth). 
In section 4 we sketch the ideas for proofs of the isomorphisms (1) and (2). 

The last two sections are a rough guide to the analysis of anti-self-dual 
instantons with Lagrangian boundary conditions, which was established in 
[W2, W3, W4, W5] in full technical detail. Section 5 provides an overview 
of the properties of gauge invariant Lagrangian submanifolds in the space of 
connections over a Riemann surface. It moreover describes the special exten- 
sion properties of Lagrangian submanifolds that arise from handle bodies. In 
section 6 we sketch the proofs of the analytic results in section 3. We put the 
proofs into context with the standard proofs of Uhlenbeck compactness (for 
anti-self-dual instantons) and Gromov compactness (for pseudoholomorphic 
curves) since - just as the results - each proof requires a subtle combina- 
tion of the best techniques from both gauge theory and symplectic topology, 
which we hope the reader will find entertaining. 
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2. Gauge theory and symplectic topology 

We give an introduction to some gauge theoretic concepts and notations. 
More details and proofs can be found in e.g. [DK, Wl]. 

Let G be a compact Lie group. The Lie algebra g = TjG is equipped 
with a Lie bracket [•, •] and with a G-invariant inner product (•,•). For the 
instanton Floer theories we will be using G = SU(2) with the commutator 
[Ci v] = s-iid the trace ( ^, 77 ) = — tr(^77) for ^, G su(2). We describe 

a connection on the trivial G-bundle G x X ^ X over a manifold X 
as a 0-valucd 1-form A € Q}{X;q) and thus denote the space of smooth 
connections by 

A{X) :=i^i(X;g). 

(The discussion in this section generalizes to nontrivial bundles, where con- 
nections are given by 1-forms with values in an associated bundle.) On the 
trivial bundle a 1-form A G A{X) corresponds to an equivariant distribution 
{{-gA{Y),Y) I Y e T^X} c T(g,^)(G x X) of horizontal subspaces. The 
corresponding covariant derivative on sections s : X ^ E of a trivial vector 
bundle with structure group G C Hom(£') is Vas : Y Vs{Y) + A{Y)s. 
The curvature of a connection A € A{X) is given by the 2-form 

FA:=dA+^[AAA] en^{X;Q). 

Throughout [-A-] indicates that the values of the differential forms are paired 
by the Lie bracket. The differential of the map A 1-^ Fa at a connection 
A G A{X) is the 'twisted' exterior derivative d^ : Q^{X;q) Q'^{X;g). In 
general, d^ : ^''{X;g) Q^'^^{X;q) acts on g-valued differential forms by 

d^ry := dr] + [A A 7]]. 

One checks that d^d^?? = [Fa A 77], so d^^ = iff the curvature vanishes. 
Such connections are called flat and we denote the set of fiat connections by 

^flatW := {AeA{X)\FA = 0}. 

Moreover, a connection is flat iff the horizontal distribution is locally inte- 
grable. So parallel transport with respect to a flat connection around a loop 
is given by an element in the group G that is invariant under homotopy of 
the loop with fixed base point x e X. Thus the holonomy induces a map 

ho\^ : Aat(^) ^ Hom(7ri(X,a;),G). 

Next, connections that are the same up to a bundle isomorphism are called 
gauge equivalent. The bundle isomorphisms of the trivial bundle can be 
identified with maps u : X ^ G that are called gauge transformations. 
Composition of bundle isomorphisms corresponds to multiplication of gauge 
transformations, so the space of smooth gauge transformations has the struc- 
ture of a group, called the gauge group 

g{X) :=C°°(X,G). 
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The action of G{X) on the space of connections A{X), called the gauge 
action, is given by pullback of the connection (i.e. the horizontal subspace 
or the covariant derivative), hence 

u*A := u'^Au + u-^du for u G g{X), A G A{X). 

The space of flat connections Ana^tiX) is obviously invariant under G{X), 
and the curvature transforms by Fu*a = u~^Fau. The holonomy of a flat 
connection A € »4flat(^) transforms by conjugation under u G Q{X), more 
precisely h.o\x{u*A) = u{x)~^h.o\x{A)u{x) for the holonomy based at x G X. 
Similarly, a change of the base point also transforms the holonomy by con- 
jugation. Hence the holonomy descends to a map 

hoi : Afi^t{X)/g{X) ^ Hom(7ri(X),G)/G =: 7^x, 

where the action of G is by conjugation. If there are no nontrivial G-bundles 
over X,^ then this is in fact an isomorphism and we will identify the repre- 
sentation space Tlx with A?iax{X)/Q{X). In general this is an isomorphism 
when taking the union over all isomorphism classes of bundles on the left 
hand side, see e.g. [DK, Proposition 2.2.3]. 

Uhlenbeck compactness. 

The observations above shows that the moduli space of flat connections 
is a compact subset of A{X)/Q{X) (in the C°°-topology). Uhlenbeck's weak 
compactness theorem is a remarkable generalization of this compactness to 
connections with small curvature. It is the starting point for all analysis in 
gauge theory, so this is a good point to introduce the Sobolev completions 
of the spaces of connections and gauge transformations. For a compact 
manifold X and for A; G No and 1 < p < oo let 

A^^^{X) := W'''P{X, T*X ® fl), g'''P{X) := W'''P{X, G). 

For kp > dimX the gauge group Q'''P{X) is a Banach manifold, on which 

multiplication and inversion are smooth, and it acts smoothly on A^~^''''{X). 
We equip X with a metric, then for any p > 1 the L^-norm of the curvature, 

||F^||^= / \Fa\^, 
■Jx 

is a gauge invariant quantity. For P = dim X this is the conformally 
invariant Yang-Mills energy of the connection, which can concentrate at 
single points. Thus for p < ^ dimX one cannot expect the compactness of 
a set of connections with bounded L^'-norm of the curvature. Uhlenbeck's 
result [U2] says that for p > ^ dimX however, every such set is compact in 
the weak W^^'^-topology on the quotient A^'P{X)/g'^'P{X). 



^This is for example the case for dimX = 2 or 3 and a connected, simply connected 
group as G = SU(2). It also holds for a handle body X and any connected group G. 
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Theorem 2.1. (Weak Uhlenbeck Compactness) 

Let X be a compact manifold and letp> ^ dimX. Suppose that Ai G A{X) 

is a sequence of connections such that \\FAi\\p is uniformly hounded. Then, 
after going to a subsequence, there exists a sequence of gauge transformations 
Ui G Q{X) such that u*Ai A^o converges in the weak W^'P -topology to a 
connection A^o G A^'P{X). 

In fact, one even has a weak VF^''^™^/^-compactness if one assumes that 
every point in X has a neighbourhood on which the Yang-Mihs energy is 
bounded by a small constant. We will need the slightly stronger W^'^- 
compactness since it allows us to globally (not just locally over small balls 
in X) work in in a local slice of the gauge action. The local slice theorem says 
that any connection A' that is suitably close to a fixed reference connection 
A can be put into relative Coulomb gauge, i.e. u*A' — yl is L^-orthogonal to 
the gauge orbit through A. The linearized gauge action TiG{X) TaA{X) 
at A G A{X) is given by dyi : Q,'^{X;g) Q^{X;q). Its formal adjoint is 
d^ = — * dyi*. More generally, with m{X,k) = {dimX — k){k — 1) the 
twisted coderivative is 

d^:=_(_l)-(^.*=)*dA* : n>'{X;g)^Q''-\X;e). 

Here we only give the sequential form of the local slice theorem. A stronger 
statement and proof can be found e.g. in [Wl, Theorem F]. 

Theorem 2.2. (Local Slice Theorem) 

Let X be a compact Riemannian manifold with smooth boundary and let 
p > ^dimX. Suppose that Ai G A^''''{X) is a sequence of connections such 
that Ai A ^ the weak W^'^ -topology. Then for sufficiently large 

i there exist gauge transformations ui G Q'^''\X) such that u*Ai A and 

d*Au*Ai -A) = 0, 
*{u*Ai-A)\Qx = 0. 

To see the strength of these two theorems consider the following example: 
Let X be a compact Riemannian 4-manifold. The extrema of the Yang- 
Mills energy J-^\Fa\'^ are called Yang-Mills instantons. They satisfy 
the equation dj^FA = and the boundary condition *FA\dx = 0, which - 
augmented with the local slice conditions - pose an elliptic boundary value 
problem. Uhlenbeck's compactness theorem for Yang-Mills instantons with 
iT'-bounded curvature then is a corollary of theorems 2.1 and 2.2. 

Theorem 2.3. (Strong Uhlenbeck Compactness): 

Let Ai G A{X) be a sequence of Yang-Mills instantons such that IIF4. ||p is 
uniformly bounded for some p > 2. Then, after going to a subsequence, there 
exists a sequence of gauge transformations Ui G G{X) such that u*Ai A^o 
converges in the C°°-topology to another Yang-Mills instanton A^o G A{X) . 
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Anti-self-dual instantons on an oriented Riemannian 4-manifold X are 
solutions A G A{X) of the first order equation 

Fa + *Fa = 0. 

By the Bianchi identity d^F^ = these are special solutions of the Yang- 
Mills equation d*^FA = 0. On a manifold with boundary however, the anti- 
self-duality equation with boundary condition *FA\dx = is an overdeter- 
mined boundary value problem comparable to Dirichlet boundary conditions 
for holomorphic maps. This is another reason why it is natural to consider 
(weaker) Lagrangian boundary conditions for anti-self-dual instantons. 

The moduli space of fiat connections over a Riemann surface. 

Let S be a Riemann surface. The natural symplectic form on the space 
of connections A{Ti) = ^}^{Ti]q) is 

(3) Lo{a,p) := [ (aAP) for a, P e n\E;g). 

Here and throughout ( • A • ) indicates that the values of the differential forms 
are paired by the inner product. Note that for any metric on S the Hodge 
operator * is a complex structure on .4(S), which is compatible with lo and 
induces the L^-metric a;(a,*^) = {a, (3) 1,2. 

It was observed by Atiyah and Bott [AB] that the action of the gauge 
group ^(S) on A{Tj) can be viewed as Hamiltonian action of an infinite 
dimensional Lie group. The Lie algebra of QiT.) is O*^(E;0) and the infini- 
tesimal action of ^ G g) is given by the vector field 

This is the Hamiltonian vector field of the function A j^{^{A) , ^ ), where 

n{A) = ^Fa 

can be considered as a moment map. Its differential is d^i{A) = *dA, so one 
indeed has for all /3 G 0^(11; g) 

u{X^{A),l3) = I (dA^A^) = - I (e,*dA/?) = - / (dM^)/?,0- 

The zero set of fi is the set of flat connections. So the moduli space of flat 
connections on S can be seen as the symplectic quotient of the gauge action, 

= ^flat(s)/6;(s) = /x-i(o)/6?(s) = 

This quotient TZs = Hom(7ri(i;), G)/G is singular at the reducible represen- 
tations, but for irreducible^ A G ^flat(S) it is a smooth manifold near the 
gauge equivalence class [A]. To understand its tangent space, notice that the 

''A connection A G .Aflat (S) is called irreducible if its isotropy subgroup of (the 
group of gauge transformations that leave A fixed) is discrete, i.e. dA|no is injective. For 
a closed Riemann surface this is equivalent to d^lni being surjective. 
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linearized action Tig(S) Ta^(S) is given by : O°(S;0) fi^(S;0). 
At a fiat connection A G .4flat(S) it fits into a chain complex with the 
differential of the moment map (since d^ o d^ = 0) , 

So the tangent space to T^s at [A] is the twisted first homology group, which 
can be identified with the harmonic 1-forms, 

T[A]'^s = ker*dA/imdA = kerd^nkerd^ =: h\. 

Hodge theory gives a corresponding L^-orthogonal splitting 

(4) = imdA © im(*dA) © /i^i 

where imd^ © /i^ = ker*dA is the tangent space to fi~^{0) = ^fiat(S) and 
im {*dA) (B h\ = (imd^)-*- is the local slice of the gauge action through A. 

We have seen that the moduli space of flat connections T^s is a smooth 
manifold of dimension (2g — 2) dim G with singularities at the reducible con- 
nections. Moreover, the symplectic structure (3) on A{T,) is C/(S)-invariant 
and induces a symplectic structure on the smooth part of TZj: . For harmonic 
representatives a, P e h\ = Tj^jT^s it is again given hj u>{a, (3) = Jj.{aAP). 
In this representation of the tangent space we also see that the Hodge oper- 
ator * descends to TZ^. So {71j:,lo) is a (singular) symplectic manifold with 
compatible almost complex structure *. 

The Chern-Simons functional and instanton Floer homology. 

Let y be a compact oriented 3-manifold. The Chern-Simons 1-form A 

on the space of connections A{Y) is given by 

XA{a):= j^{FAAa) for a e T aA{Y) = n\Y ; g) . 

This 1-form is equivariant, \u*A{W^au) = Aa(q;). If dY = or FaIoy = 0, 
then A is also horizontal and thus descends to the (singTilar) moduli space^ 
B{Y) := A(Y)/Q{Y). Indeed, a tangent vector to the gauge orbit through 
A G A{Y) has the form a = d^C with ^ G 0°(y; g), and by Stokes' theorem 
and the Bianchi identity 

(5) \A{dAO = - [ {dAFA,0+ [ {Fa,0 = 0. 

Jy Jdv 

To calculate the differential of A consider a, (3 ^ il^{Y;g) as (constant) 
vector fields on A{Y), then their Lie bracket vanishes and 

dA(a,/3) = Va(A(/3)) - V;3(A(a)) 

(6) = [ {dAaAP)- [ {dApAa) = [ {aA(5). 

Jy Jy Jdy 



®Note that B{Y) is not the moduh space of flat connections TZy, but the infinite 
dimensional and singular space of all connections modulo gauge equivalence. 
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So for dY = the Chern-Simons 1-form descends to a closed 1-form on 
B{Y). In fact, A is the differential of the Chern-Simons functional 

cs{A) ■.= iJ^{aa{Fa-1[aaa])). 

For a more illuminating definition let X be a compact 4-manifold with 
boundary dX = Y, then for any A G A{X) with A\gx = A 

CSiA) = l [ {F^AF^}. 
Jx 

For closed X the right hand side is a topological invariant of the bundle. We 
fix G = SU(2), tlicn this invariant is 47r^C2(-P), where ^ is a connection on 
the bundle P X. From this one can see that the Chern-Simons functional 
descends to an 5'^-valued functional CS : B{Y) M/47r^Z since it changes 
by CS{A) — CS{u*A) = 47r^ deg(n) G 47r^Z under gauge transformations. 
If y is a homology 3-sphere, then Floer [Fl] used the generalized Morse 
theory for this functional to define the instanton Floer homology HFJf** (Y) . 
Roughly speaking, the Floer complex is generated by the zeros of dCS = A, 
i.e. by the flat connections A G Afie,t{Y) modulo G{Y). The differential on 
the complex is defined by counting negative gradient flow lines, so wc choose 
a metric on Y and thus fix an L^-metric on A{Y) . Then the gradient of CS 
is ^ *Fa and a negative gradient flow line is a path ^ : M — > A(Y) 
satisfying 

dsA = -* Fa. 

Equivalently, one can view this path as connection S = $ds-|- A G v4(M x Y) 
in the special gauge $ = 0. Then the above equation is the anti-self-duality 
equation Fs + *Fs = for S. For a general connection S G A{M. x Y) this so- 
called temporal gauge can always be achieved by the solution u G t/(Mxy) of 
dsU = —^u with u\s=o = 1. So the negative gradient flow lines of the Chern- 
Simons functional modulo Q{Y) are in one-to-one correspondence with the 
anti-self-dual connections H G A(K x Y) modulo Q{R x Y). An extensive 
discussion of instanton Floer homology for closed 3-manifolds can be found 
in Donaldson's book [D]. 

If Y has nonempty boundary dY = E, then the differential (6) is the 
symplectic form lo on alE,/3|s G A{T,), compare (3). To render A closed, it 
is natural^ to pick a Lagrangian submanifold £ C A{^) and restrict A to 

AiY, C) := {A G A{Y) I A|s G £}. 

More precisely, we fix a p > 2 and make the following assumptions to ensure 
that A defines a closed 1-form on B(Y,C) := A{Y,jC)/g{Y). 



^If C C .A(S) is any submanifold, then the closedness of X\a(y,c) equivalent to 
uj\c = 0, and the maximal such submanifolds are precisely the Lagrangian submanifolds. 
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(i) L C is a Banach submanifold that is isotropic, cjI/; = 0, and 
coisotropic in the sense of the following implication for all a G 

If uj{a, /3) = for all /? G TaC, then a G Ta>C. 

(ii) /3 is invariant under Q^''^{Yj). 

(iii) C C lies in the space of weakly flat connections/ 

Here (ii) ensures that Q^) acts on A{Y^C)^ and (iii) implies that A is hori- 
zontal by (5) . These assumptions also imply that L descends to a (singular) 
Lagrangian submanifold in the (singular) moduli space of flat connections, 

L := (S) C 7^s = ^flat(S)/g(S). 

The assumptions (i)-(iii) also imply the orthogonal splitting, see section 5, 

r?i(S; 0) = TaC © *TaII for all A^L. 

Compare this to (4) and note that im d^ C Tyi>C C kcr A a due to (ii),(iii). So 
the T^£ are determined up to a choice of Lagrangian subspaces in Con- 
versely, any Lagrangian L C 7?.s lifts to a (possibly nonsmooth) L C .4°'^(S) 
as above. In order to obtain a well defined Floor homology one should 
moreover assume that L is simply connected (which ensures a monotonicity 
property). In general, C is not simply connected, but its fundamental group 
cancels with that of t/(S). This is the reason why A is not exact but can only 
be written as the differential of the multi-valued Chern-Simons functional 

CSc^A) = \ [ {Aa{Fa-1[AaA]))+ [' [ {A{t)AdtA{t))dt. 
Jy Jo Jt, 

This involves the choice of a path ^ : [0, 1] — > £ with ^(1) = A\y, and 
Jl(0) = Aq a, fixed reference connection in C Again we fix G = SU(2) to 
obtain a functional CSc '■ A{Y,C) R/47r^Z, which directly descends to 
B{Y,C) since the gauge group Q(Y) is connected. We now propose to define 
a new Floer homology HF™^*(y, C) from the generalized Morse theory of the 
functional CSc ■ B{Y,C) R/Att'^'L. 

A critical point in this theory is a flat connection A G ^fiat(^) with 
Lagrangian boundary condition A\y, G £ (modulo Q{Y)), and a negative 
gradient flow line is a path A : M ^ ■A.{Y) (modulo Q{Y)) satisfying 

(7) dsA = -* Fa, A(s)|s G £ Vs G M. 

Again, this is the anti-self-duality equation for S = ^ -|- $ds G .4(M x Y) in 
the temporal gauge $ = 0. So the gauge equivalence classes of the gradi- 
ent flow lines are in one-to-one correspondence with the gauge equivalence 
classes of anti-self-dual instantons with Lagrangian boundary conditions, i.e. 
solutions S G A{^. x Y) of the boundary value problem 

(8) Fs + *Fh = 0, S|{,}xse>C VsgM. 

^See [W2, Sec. 3] or use the fact ^fl'^tCE) = ai'P(S)Mflat(S) as definition. The 
conditions (ii) and (iii) are equivalent when G is connected and = g, e.g. for SU(2). 
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Lagrangians and handle bodies. 

We have seen before how a Riemann surface S gives rise to a (singular) 
symplectic manifold TZj] = Hom(7ri(S), G)/G, which is a finite dimensional 
reduction of a symplectic Banach space A{T,) = 0^(S;g) that arises from 
gauge theory on S. We will now discuss a class of examples of Lagrangian 
Banach submanifolds Ch C A(T,) that arise from gauge theory on a handle 
body H with dH = S, and that reduce to finite dimensional (singular) La- 
grangian submanifolds Lh = Hom(7ri(i/), G)/G C T^s- Here and through- 
out a handle body is an oriented 3-manifold with boundary that is obtained 
from the 3-ball by attaching a finite number of 1-handles. 

For this purpose let G be a compact, connected, and simply connected 
Lie group (e.g. G = SU(2)) and let S be a Riemann surface. For a start let 
H be any compact 3-manifold with boundary dH = S. Then 

Ch := {i|s I A e A^^tiH)} c A{^) 

satisfies the assumptions (ii) Ch C .4flat(S), (iii) Q{T,)*Ch = Ch,^ and is 
isotropic: Consider paths ^1,^2 : (—£;£) -4flat(-f^) with Ai{0) = A, then 
d^dtAi{0) = dtl^^^F^, = and hence with the symplectic form (3) 

Lo{dtAi{0) , dtA2{0)) = jQjj{dtAi{0)AdtA2{0)) 
= /^(d^5tii(0) A dtA2{0) ) - (5tii(0) A d^dtA2{0) ) = 0. 
So Ch descends to an isotropic subset in the symplectic quotient 

Lh := ChM^) C 7^s = ^(S)//g(S). 
The holonomy provides an isomorphism 

Lh = Hom(g|J(^,G)/G C 7^E = Hom(7ri(S), G)/G. 

This is since the holonomy of a flat connection on H is trivial on the con- 
tractible loops in dTT2{H, S); and all representations of TTi{T,)/diT2{H, S) can 
be realized by a fiat connection on H since that quotient embeds into Tri{H) 
by the long exact sequence for homotopy 

> TT2{H) ^ 7T2{H, S) ^ ^i(S) ^ TTiiH) ^ TTi (//, S) ^ . . . 

This also shows that g^,^I^HT.) ~ ^i(^) if -f^ is a handle body (so 'K2{H) 
and 7ri(iJ, S) vanish). Now consider the commuting diagram of long exact 
sequences for homology and cohomology with the vertical Poincare duality: 

H2{H,11) ^ i7i(S) ^ Hi{H) 
I I I 

*This uses the assumption 7ri(G) = {0} and the fact that 7r2(G) = {0} for every 
compact Lie group, so that every gauge transformation m : E — > G extends to w : — » G. 
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One can read off that (imd)-^ = (imi*)^ = (kerd*)-^ = imd, and we obtain 
dim qh^Ih^t.) ~ ^dimHi{T,). Hence dim Lh = ^diniT^s at smooth points. 
So a general compact 3-manifold H with dH = S gives rise to a (singular) 
Lagrangian Ch C TZj^, and in fact Ch C A{T,) is Lagrangian up to possible 
singularities. If iJ is a handle body, then one can prove that Ch is in fact 
smooth, ^ which is essentially due to the fact that q^^^\^ — t^i{H) is a 
free group. 

This correspondence between low dimensional topology, symplcctic topol- 
ogy, and gauge theory is summarized in a table on page 20. To round off this 
discussion, note that a Heegard splitting Hq Us Hi of a 3-manifold into two 
handle bodies Ho,Hi with common boTindary OHi = S gives rise to a pair 
of (singular) Lagrangians in a symplectic manifold, L^q, C TZt,- Now by 
the Atiyah-Floer conjecture there should be a natural isomorphism between 
the topological invariant HFlf^*(iJo Us H]) and the symplectic invariant 
HF*'*'™^(7^S) -^i/o5 -^-ffi) ~ assuming that the first is defined, i.e. Hq U H\ is 
a homology 3-sphere, and that the second can be defined in spite of the 
singularities. On the gauge theoretic side one obtains two smooth (though 
infinite dimensional) Lagrangian submanifolds Chq,Chi C AiT), to which 
we can associate the new invariant HF™***([0, 1] x x Chi)- This in- 

variant is more generally defined in the setting below, where we again fix 
G = SU(2). Here we replace [0,1] x S by a more general 3-manifold Y 
with boundary with boundary dY = S. Then for a union of handle bodies 
H = \_\Hi with boundary dH = |J Sj = S we denote by Ch C A{Ti) the 
Lagrangian submanifold Chi, x • • • x Ch^ C A{T,q) x • • • x A(T,]sf). 

Theorem 2.4. ([SW]) Let Y be a compact, oriented 3-manifold with 
boundary S. Let H be a disjoint union of handle bodies with dH = T,, and 
suppose that Y Uji H is a homology 3-sphere (with Z-coefficients). Then the 
Floer homology HFlf^*(y, /3//) is well-defined and independent of the metric 
and perturbations of (7) and (8) used to define it. 

In this setting, Floer 's original invariant HF!f***(y Us H) is also defined, 
and we expect our invariant to carry the same information. 

Conjecture 2.5. There is a natural isomorphism 

RFr\Y,CH) = iiFr\Y Us H). 

Hence the new Floer homology with Lagrangian boundary conditions fits 
into the Atiyah-Floer conjecture as well as for an approach to defining an 
invariant for more general 3-manifolds. In the next section we explain its def- 
inition in more detail for the model case Y = [0, 1] x S and Ch = Chq X Chi, 
which also is the relevant case for the Atiyah-Floer conjecture. 



Its L''-completion is a Banach submanifold of A^'^C^), see section 5. 
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3. Instanton and symplectic Floer homologies 

This section sketches the instanton and symplectic versions of Flocr theory 
and compares the analytic behaviour of the underlying trajectory equations. 
The purpose of this is to explain the definition of the new instanton Floer 
homology with Lagrangian boundary conditions (in-L) and to show how it 
fits between the instanton Floer homology (inst) and the symplectic Floer 
homology (symp) and thus provides an intermediate invariant for approach- 
ing the Atiyah-Floer conjecture. In fact, its trajectories exhibit this inter- 
polation between anti-self-dual instantons (in their interior behaviour) and 
pseudoholomorphic curves (in their semiglobal behaviour at the boundary), 
(inst): Let y be a homology 3-sphere, i.e. a compact oriented 3-manifold 
with integer homology H^{Y, Z) = i7^,(5^, Z). The instanton Floer homology 
jjpinst^y^ was defined by Floer [Fl]. The basic analytic results for this setup 
that will be quoted below are mainly due to Uhlenbeck [Ul, U2]. 
(in-L): Let Y = HqU-^ Hi be the Heegard splitting of a homology 3-sphere 
into two handle bodies Hq,Hi with common boundary dHi = S. We de- 
scribe the special case HF™^*([0, 1] x Yj,Chq x Chi) of the new instanton 
Floer homology with Lagrangian boundary conditions of theorem 2.4. The 
analytic results for this case are established in [W3, W4]. 
(symp): Let (M, w) be a compact symplectic manifold and assume that 
it is simply connected, positive (ci(TAf) = X[uj] with A > 0), and has 
minimal Chern number N >2 (where (ci,7r2(M) ) = NTj). Let Lo,Li C M 
be two simply connected Lagrangian submanifolds. Then the symplectic 
Lagrangian intersection Floer homology }iF^/^'^{M, Lq, Li) is defined by 
[F2] and many other authors. The underlying analytic fact here is Gromov's 
compactness for pseudoholomorphic curves [G]. 

The instanton cases use the trivial SU(2)-bundle as before. In the third 
case one should think of Af = TZy, and Li = Lh^- However, their Floer ho- 
mology is not yet well-defined due to the quotient singularities. We do not 
give complete definitions of the Floer homologies here. More detailed expo- 
sitions can be found in e.g. [D, Sal]. In particular, we do not mention the 
necessary perturbations of the equations for critical points and trajectories. 

Definition 3.1. A critical point is 

(inst): a flat connection A € ^flat(y)- 

(in-L): a flat connection A + ^dt G ^fiat([0, 1] x S) with Lagrangian 

boundary conditions A{j) G for j = 0, 1. 
(symp): an intersection point a; G Lq fl Li. 

In all three cases, the Floer chain complex is generated by the critical points, 

CF, = Z{x). 

X crit.pt. 
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(In the two instanton cases the generators actuaUy are gauge equivalence 
classes x = [A] or x = [A + '^dt], and the trivial connection is disregarded.) 
The boundary operator d : CF* CF* is defined by counting trajectories, 

d{x-)= J2 #M\x-,x+){x+). 

a;+ crit.pt. 

Here A4^{x~ , is the 0-dimensional part of the space of trajectories from 
x~ to x~^. This will be a smooth, compact, oriented manifold, so its points 
can be counted with signs. The trajectory equations will be given below for 
the three cases. The main issue that we then discuss is the compactness 
of the space of trajectories, which will allow the definition of d. To obtain 
a chain complex, one moreover has to establish 5 o 5 = by identifying 
the boundary of the 1-dimensional part of the space of trajectories with the 
broken trajectories that contribute to d o d. The Flocr homology in the 
different cases then is the homology if*(CF,5) of the corresponding Floer 
chain complex. It is graded modulo 8 in the instanton cases and modulo 2N 
in the symplectic case. 

The trajectory equation depends on the choice of auxiliary data, that the 
Floer homology will not depend on. In the instanton cases this is a metric 
on Y or [0, 1] x S respectively. (In the second case we will give the equation 
for a product metric.) In the symplectic case we fix an cj-compatiblc almost 
complex structure J on M. The moduli space of trajectories then is the 
space of solutions of the trajectory equation modulo time shift (in the M- 
variable) and modulo gauge equivalence in the instanton cases. 

Definition 3.2. A trajectory is a solution of the trajectory equation (T). 
(inst): An anti-self-dual instanton on M x Y: 

B -.M.^ A{Y) satisfying 

(T) dsB + *Fb = 

(in-L): An anti-self-dual instanton on R x [0, 1] x S with Lagrangian 
boundary conditions: 

{A, *) : M x [0, 1] ^ ^(S) x C°°(i;,su(2)) satisfying 

' dsA + *idtA - dA^) = 
(T) J ds"^ + *Fa = 

^A{s,j)ejCH, VsGM,jG{0,l} 

(symp): A J -holom,orphic strip with Lagrangian boundary conditions: 
■u : R X [0, 1] ^ M satisfying 
dgU + JdfU = 

uis,j)eLj VseR,jG{0,l} 



(T) 
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Pictures of these trajectories and a table that summarizes the definitions 
and results for the three Floer theories can be found on page 20 and 21. 
The equation in case (in-L) is dgB + *Fb = for B = A + '^dt, and in 
both instanton cases this is the anti-self-duality equation for the connection 
S = Ods + B m. temporal gauge; c.f. section 2. 

To ensure that the trajectories converge to critical points as the M-variable 
tends to ±00, one needs some a priori bound. This is provided by energy 
functionals given in the lemma below (a consequence of theorems 3.4, 3.5). 

Lemma 3.3. If a trajectory has finite energy £, then it converges (expo- 
nentially) to critical points as R 9 s — > ±00. 

(inst): ^^B) = [ \d,B\^ < 00 

^B{s) — > B^eA^y) 

s— >±oo 

jRx[0,l]xS 

^A{s) + ^{s)dt ^± + ^'±dt G Aat([0,l] xy); 

s— >±oo 

A^{Q)eCH,,A^{l)&CH, 
(symp): ^ f |^^„|2 < ^ 

JRx[0,l] 

^it(s, •) — i- x^^GLoflLi 

s— >±c» 

In the two instanton cases, the energy of a trajectory equals to the Yang- 
Mills energy | / of the corresponding anti-self-dual connection. In all 
cases the energy is conformally invariant, so by rescaling one solution one 
can obtain a sequence of solutions (on a ball) whose energy is bounded, but 
that blows up at one point - where all the energy concentrates. This effect 
can be excluded by assuming that the energy density does not blow up. For 
all three equations, this is enough to obtain Cj^^-compactness. 

Theorem 3.4. (Compactness) Consider a sequence of trajectories and 
suppose that their energy density is locally uniformly hounded: 

(inst): \dsB.i\^ is locally uniformly hounded on M x y. 

(in-L): ||3sAj||^2(2) + ll-^-^i IIl2(e) ^"^ locally uniformly hounded on M x [0, 1]. 

(symp): is locally uniformly hounded on R x [0, 1]. 

Then, after going to a suhsequence, and in the cases (inst), (in-L) applying a 
sequence of gauge transformations gi £ Q{WxY) or gi £ G(M.x [0, 1] x S), the 
trajectories converge uniformly with all derivatives on every compact suhset 
(i.e. in the C^^-topology) to a new trajectory. 
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The compactness statement in case (in-L) in fact also holds when the 
Lagrangians £77. are replaced with general gauge invariant Lagrangians as 
on page 10. This result was proven in [W3] under the (stronger) standard 
assumption from gauge theory that = + l-fkiP is locally uni- 

formly bounded on M x [0,1] x S (or is locally I^-bounded for p > 2). 
The weaker assumption above implies pointwise bounds in the interior by a 
mean value inequality. Near the boundary this is not a direct consequence, 
but an extra argument [W4, Lemma 2.4] provides local L^-bounds for any 
p < 3. Thus we can state the compactness result in this form, which already 
hints at a similar behaviour to pseudoholomorphic curves on M x [0, 1]. This 
stronger statement becomes crucial in the bubbling analysis below. 

The goal of our analytic discussion of the trajectory equation is to un- 
derstand the compactness or compactification of the /c-dimensional part 
A4^{x~ ,x^) of the space of trajectories with fixed limits x^. (Here A; = 
and k = 1 are relevant for the definition of d and for the proof of dod = 0.) 

The assumptions in theorem 3.4 are too strong for that purpose since we 
only have a bound on the energy, not on the energy density, of trajectories in 
j\4^{x~ , x^). In fact, in the three present cases the energy of a trajectory is 
uniquely determined by its limits x~ ,x~^ and its index k via a monotonicity 
formula. So we need to consider a sequence of trajectories with fixed en- 
ergy and analyze the possible divergence of the sequence when the uniform 
bounds in theorem 3.4 do not hold. This divergence is usually described by 
the 'bubbling off' of some part of the trajectory: In the case (inst) the 'bub- 
bles' are instantons on S^; in the case (symp) they are pseudoholomorphic 
spheres or disks. In the new case (in-L) we also encounter instantons on 
5^ 'bubbling off' at both interior or boundary points. Additional 'bubbles' 
in the form of anti-self-dual instantons on the half space were expected in 
[Sa2]. Our result below now seems to indicate a semiglobal bubbling effect 
at the boundary, which conjecturally might be described as a holomorphic 
disk in the space of connections A{T,). Fortunately, the geometric under- 
standing of the bubbles is not necessary for the purpose of Floer theory in 
the monotone case. It can be replaced by an analytic understanding of the 
bubbling in the form of the following energy quantization result. 

For the purpose of this statement we abbreviate y = [0, 1] x S in case 
(in-L) and Y = [0, 1] in case (symp), so all trajectories are defined on M x y. 

Theorem 3.5. (Energy Quantization) There exists a constant h > 
such that the following holds. Consider a sequence of trajectories whose 
energy is bounded by some E < 00. 

Then, after going to a subsequence, the energy densities are locally uni- 
formly bounded as in theorem 3.4 on (M x y)\IJ^i Pk, the complement of a 
finite union of bubbling loci Pk as below. At each bubbling locus Pk there is 
a concentration of energy of at least h on neighbourhoods with radii — > 0. 
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(inst): Each bubbling locus is a point = Xfc € M x y with 



L 



(in-L): Each bubbling locus is 

either an interior point Pfc = Xfc G M x (0, 1) x S with 

I \dsAi\^ + \FA^\^>h, 

JBeAxk) 



or a boundary slice Pk = {{sk,tk)} x S, (sfe,tfe) G M x {0, 1} with 



Ib, 



(symp): Each bubbling locus is a point = (sfe,ife) G M x [0, 1] with 



f Ifl „. |2 

J Be- (Sfc,tfc) 



dsUi\ > h. 



In case (in-L) both an instanton on S'^ bubbling off at a boundary point 
and the conjectural holomorphic disk in A{T,) are described by a boundary 
slice as bubbling locus. The proof in case (in-L) goes along the lines of 
an energy quantization principle explained in [W5] but deals with some 
additional difficulties. In the cases (inst) and (symp) the above result can be 
obtained straight forward from this principle and a control on the Laplacian 
(and normal derivative) of the energy density. See section 6 for details. 

The combination of theorems 3.4 and 3.5 can be rephrased as: 'There is a 
Cj^^-convergent subsequence if the energy is locally small.' In the cases (inst) 
and (symp) it is sufficient to assume that every point in M x 1" or M x [0, 1] 
respectively has a neighbourhood on which the energy of each trajectory in 
the sequence is less than h. In the case (in-L) this assumption is the same 
for points in the interior M x (0, 1) x S. For a point {s,j, z) G M x {0, 1} x S 
on the boundary however, it is not enough to assume that the energies are 
small on a neighbourhood of that point, but one needs to assume that there 
is a neighbourhood of the whole boundary slice {{s,j)} x S on which the 
energy of each trajectory in the sequence is less than h. 

The full consequence of theorems 3.5 and 3.4 is the following compactness. 

Corollary 3.6. Consider a sequence of trajectories with energy bounded 

by E < oo. Then, after going to a subsequence, there exist finitely many 
bubbling loci Pi, ... , Pjv as in theorem 3.5, and in the cases (inst) and (in-L) 
there exists a sequence of gauge transformations in ^((M x 1") \ {J^^i Pk), 
such that the trajectories converge (after gauge transformation) in the C^^- 
topology on (M x y) \ U^=i to a new solution of the trajectory equation 
(T) on (R X y) \ U,Li Pk with energy S < E - Nh. 
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Keep in mind that the bubbling loci Pk and thus the singularities of the 
new solution obtained in corollary 3.6 are always points, except for the case 
(in-L) where 2-dimensional singularities can occur at the boundary. The 
next step in the compactification (or proof of compactness) of the spaces 
of trajectories is to remove these singularities. We give a general statement 
that is a consequence of the subsequent removable singularity theorems for 
the local models of the singularities. 

Here i?" denotes the unit ball in R" centered at 0, and D'^ := B'^ n is 
the unit half ball in the half space = {{s,t) eM?\t>0} with center 0. 
In the two boundary cases, the Lagrangian submanifold Ch or L can be 
either of the two or Lj respectively. 

Theorem 3.7. (Removal of Singularities) Consider a smooth solution 
of the trajectory equation (T) on (M x Y) \|J^i Pk that has finite energy E. 
Then (in case (inst) and (in-L) after applying a gauge transformation in 
Q{(R. X y) \ UfcLi-Pfc)j the solution extends to a trajectory on R x y with 
energy E. 

(inst), (in-L, interior): Suppose that S G A{B^ \ {0}) satisfies 
Fs + *Fs = and I iFsP < cx). 



Then there exists a gauge transformation g G Q{B^ \ {0}) such that g*E 
extends to a solution S G AiB"^). 



and I I iFsp < oo. 



(in-L,boundary): Suppose that E G A{{D'^ \ {0}) x S) satisfies 
Fs + *Fs = 

"l{(s,o)}xs e ^i? Jd^\{o}Jj: 

Then there exists a gauge transformation g G G{{D'^ \ {0}) x S) such that 
g*E extends to a solution E G A^D"^ x S). 

(symp, boundary): Suppose that u G C°°{D'^ \ {0},M) satisfies 

( dsU + Jdtu = r 

<^ and / \dsu\ < oo. 

Then u extends to a solution u £ C^{D'^,M). 

(symp, interior): Suppose that u G C°°{B^ \ {0},M) satisfies 

dgU + JdfU = and / l^s'f^P < oo. 
Then u extends to a solution u G C°°{B'^, M). 
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In the case (in-L) Uhlenbeck's removable singularity theorem [Ul] applies 
to the bubbling loci in the interior. At the boundary we have to remove 2- 
dimensional singularities of an anti-self-dual instanton. In the interior there 
would be an obstruction to removing such singularities: The holonomies of 
small loops around the singularity might have a nontrivial limit. So it is im- 
portant to note that this 'pseudoholomorphic behaviour' of the (in-L) trajec- 
tories only occurs at the boundary, where one does not have an obstruction 
since there are no loops around the singularity. One can then imitate the 
removal of the singularity of a pseudoholomorphic curve on D'^ \ {0} with 
Lagrangian boundary conditions to remove the singularity of an anti-self- 
dual instanton on (D^ x {0}) x S. This uses an isoperimetric inequality for 
a local Chern-Simons functional instead of the local symplectic action. So 
far, the definition of this local Chern-Simons functional crucially uses the 
fact that the Lagrangian boundary condition arises from a handle body. 

The final result of the analysis of trajectories in theorems 3.4, 3.5, and 3.7 
is that the moduli spaces of trajectories are compact up to 'bubbling' and 
'breaking of trajectories'. Here 'bubbling' means the concentration of energy 
at a bubbling locus as in theorem 3.5. The 'breaking of trajectories' occurs 
when a sequence of trajectories with constant energy converges smoothly 
on every compact set to a new trajectory, but the limit has less energy. In 
that case, the energy difference must have moved out to s ^ ±00 and can 
be recaptured as the energy of a limit of shifted trajectories. A standard 
iteration of such shifts yields a finite collection of trajectories (a 'broken 
trajectory') whose total energy equals to the fixed energy of the sequence. 

To proceed with the definition of d and the proof oi dod = Q one needs to 
perturb the trajectory equation (T) so that the moduli spaces M^{x~ ,x^) 
of trajectories become smooth manifolds. Here a priori G Z is the index of 
a Fredholm operator (the linearization of (T)) associated to the trajectories. 
For a smooth moduli space, k equals to the dimension of the component, 
hence M.^{x~,x'^) is empty for k < —1. By a monotonicity formula, k 
moreover determines the energy of the trajectories such that a trajectory 
of lower energy has to lie in a moduli space of lower dimension. From this 
one can deduce that M.^{x^ ,x^) is compact (and thus can be counted to 
define d): It consists of trajectories with the minimal energy that allows 
to connect x~ to x"*". So bubbling can be ruled out since (after removal of 
the singularities) it would lead to a trajectory of even lower energy. The 
breaking of trajectories is ruled out by a similar index-energy argument. 

Bubbling is also excluded in M.^{x~ , a;"*") for < 7 (or 2N — 1 in the sym- 
plectic case) since x~ and x~^ determine the index k modulo 8 (or 2A'^). So 
a loss of energy corresponds to a jump by 8 (or 2A'^) in the dimension. The 
breaking of trajectories is no longer ruled out; on the contrary, d od = {) fol- 
lows from the fact that the ends of the 1-dimensional moduli spaces exactly 
correspond to the broken trajectories which are counted hy d o d. 
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4. The Atiyah-Floer conjecture 



To give a precise statement of the Atiyah-Floer conjecture we need to refine 
the notion of handle bodies and Heegard splittings. A handle body is 
an oriented 3-manifold with boundary that is obtained by attaching finitely 
many 1-handlcs to a 3-ball. The spine of a handle body H is a graph 
S C H embedded in its interior that arises from replacing the ball by a 
vertex and the handles by edges with ends on this vertex. Its significance is 
that H \ S = [0,1) X dH, so H retracts onto S. For each genus 5 G No we 
fix a standard handle body and spine S C H. 

Definition 4.1. A Heegard splitting of a dosed oriented 3-manifold Y 
consists of two embeddings ipi : H ^ Y of a standard handle body H such 
that '4)Q{dH) = ipi{dH) = imV'oHimV'i- We abbreviate the Heegard splitting 
byY = Ho Us Hi, where H, := ijjiiH) C F and S := ipiidH) = Fi n H2. 

Next, a homology 3-sphcrc is a compact oriented 3-manifold Y whose 
integer homology is that of a 3-sphcrG, i7^<(y, Z) = H^:{S^ ,Z,). 

Conjecture 4.2. (Atiyah— Floer) Let Y be a homology 3-sphere. Then 
every Heegard splitting Y = Hq Us Hi induces a natural isomorphism 



Here 'natural' in particular means that the isomorphism should be in- 
variant under isotopics of the Heegard splitting. Note that for nonisotopic 
Heegard splittings of the same genus one can identify the T^s, but the pairs of 
Lagrangians (and thus the conjectured isomorphism) will be different. The 
conjecture would then provide isomorphisms between the symplectic Floer 
homologies arising from different Heegard diagrams of the same 3-manifold. 

The first task posed by this conjecture is to give a precise definition of 
the symplectic Floer homology for the Lagrangians Lhq , Ljj^ in the singular 
symplectic space TZs. They can be viewed as symplectic quotients of the 
gauge action on the smooth Banach-manifolds Cho,^Hi C A{T,) (see [AB] 
and section 2). For finite dimensional Hamiltonian group actions, Salamon 
et al. introduced invariants based on the symplectic vortex equations on the 
total space, see e.g. [CGMS]. Gaio and Salamon [GS] identified these with 
the Gromov-Witten invariants for smooth and monotone symplectic quo- 
tients. In view of this result, a plausible definition of HF|^™^(7^s, Lhq,Lh]) 
could be to replace its ill-defined trajectories (pscudoholomorophic curves 
in the singular symplectic quotient) by solutions of the corresponding sym- 
plectic vortex equations: A triple of maps ^4 : M x [0, 1] — > A{S) and 



^¥T\Y) ^ HFf-P(7^s,L^o,^^^l)• 
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Here ^ dyi$ is the infinitesimal action and A i-^ *Fji is the moment 
map of the gauge action, where * is the Hodge operator of a metric gs on S. 
This system is the anti-sclf-duahty equation with Lagrangian boundary con- 
ditions for the connection ^ds+"i>dt+A on M x [0, 1] x E with respect to the 
metric ds^+dt^+^s, i-e. the trajectory equation of definition 3.2 in temporal 
gauge $ = 0. So in this case the symplectic vortex equations lead directly to 
the new Floer homology HF!f^*([0, 1] x Ti^Cua ^ ^Hi), which is well-defined 
since ([0, 1] x S) U {Hq U ifi) = ifo Us Hi is a homology 3-sphere. Defining 
HF*-*'™''(7^s, -^i?o' '^i* (9) would reduce the Atiyah-Floer conjecture 4.2 
to the subsequent special case of conjecture 2.5. We intend however to give 
a less far fetched definition of the symplectic Floer homology and use the 
following only as first step towards a proof of the Atiyah-Floer conjecture. 

Conjecture 4.3. Every Heegard splitting Y = Hq Us Hi of a homology 
3-sphere induces a natural isomorphism 

jjpmst(y) ^ HFi'^^*([0, 1] x ^,£ho X Ch,). 

To prove this, one has to identify the critical points and trajectories of 
both Floer homologies. Our idea for a proof uses the following decom- 
position of Y. We restrict the embeddings V'i to the complement of the 
spine H \ S = [^,1) X T: and glue them at {^} x E to obtain an embedding 
-0 : (0, 1) X S y such that ^(^, •) = ids and ip{t, E) converges to the spine 
'tpi{S) G Hi as t ^ i for i = 0,1. Then 

Y = H^^UYsUHf; := ^([<5, 1 - 5] x E). 

Here the Hf C Y are isotopic to the open handle bodies int(ifj) and 
Ys = [0, 1] x E via ^ o ts, where ts : [0,1] x T, [6,1 — 5] x T, is the obvious 
linear isomorphism. With this the critical points can be identified elemen- 
tary as follows: Every A G AfiatiY) can be decomposed and pulled back 
to a triple {A,Ao,Ai) of A G ^flat([0, 1] x E) and Ai G AdatiHi) such that 
^l{i}xs = Ai\dHi- So every critical point [A] G TZy corresponds to the gauge 
equivalence class of a flat connection on [0, 1] x E with boundary values in 
Cho and Chi ■ One can check that this in fact gives a bijcction between the 
critical points. In order to prove conjecture 4.3 one needs to show that the 
induced map between the Floer complexes is a chain isomorphism. 

For that purpose we fix a metric on Y and for a corresponding met- 
ric on [0, 1] X E try to establish a bijection between the trajectories that 
contribute to the differential on the two Floer complexes. (Of course, we 
have to prove later that the isomorphism is independent of the choices). 
A fixed metric on Y gives rise to a family of metrics gs on [0, 1] x E 
via pullback by o Td : [0, 1] x E ^ C Y. The metrics gs degenerate on 
{0} X E and {1} x E for 5 — > 0, but for sufficiently small S > we ex- 
pect to find a bijection between the trajectories of HF!f^*(y) and those of 
HFif'*([0, 1] x T,,Cho X ^Hi) with respect to gs- 
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The first are anti-self-dual instantons (in temporal gauge) on M x y, that 
is S : M ^ A{Y) satisfying 

dsB + *Fb = on M X y. 

The latter are anti-self-dual instantons (in temporal gauge) A + '^dt on 

M X [0, 1] X E with Lagrangian boundary conditions. Here the metric gs on 
[0, 1] X E is not of product form, so the equation (T) in definition 3.2 has 
to be adjusted: The pair {A, is a trajectory if ^ -|- ^dt = Tgijj*B, where 
B : R ^ A{Ys) is anti-self-dual with respect to the fixed metric on Y and 
has boundary values in Chq and Chi , that is 
' dsB + *FB = onMxy^, 

< 5|v>({5}xS) = ^0 for some Bq-.R^ ylfiat(i^o)' 
, -B|^(|i_5}xs) = Bi for some 5i : M ^ A{ii,t{Hf). 

The task in identifying the trajectories is to consider anti-self-dual instantons 
on Ys and transfer between extensions B^ -.M. ^ A{Hf) that are slicewise flat 
(Fg. = 0) and extensions that are anti-self-dual {dgBi + *Fg. = 0). Here the 
handle bodies Hf C Y are small tubes around their spines ijji{S) C Y. The 
restriction of given (anti-self-dual) connections Bi to the spines is up to gauge 
equivalence determined by their holonomies, i.e. S'C/(2)-representations of 
7ri(i?i). One can then pick flat connections on the that have the same 
holonomy and are close to the Bi (compared to their energy). For the con- 
verse we will have to use special flat extensions Bi with a control on dsBi 
as in lemma 5.3. Combined with the small volume of this should make 
Bi close to anti-self-dual. 




Degenerations of the metric on [0, 1] x S 

The key to this plan of proof is the fact that one can degenerate the metric 
on [0, 1] X S (as sketched on the left in the above figure) without changing 
the invariant HF™***([0, 1] x S, Ch^ x Chi)- In the limit of the degeneration 
one should obtain the invariant HF™^*(F) for the closed manifold. The basic 
idea of the second step for the Atiyah-Floer conjecture is to use a second 
degeneration (on the right in the above sketch) to transfer from anti-self- 
dual instantons to pseudoholomorphic curves. This idea was successfully 
employed by Dostoglou and Salamon [DS] in their proof of a mapping torus 
analogon of the Atiyah-Floer conjecture. 
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A trajectory of the symplectic Floer homology should be a pseudoholo- 
morphic map -u : R x [0, 1] — > TZs with boundary values in Lh^ and Lhi , 

(10) dsu + J{u)dtu = 0, u{s,i)eLHi Vs€M,i = 0,l. 

Here we choose the almost complex structure J on TZ-£ that is induced by 
the Hodge operator of some fixed metric g-£ onH. Let us first assume that 

u takes values in the irreducible representations, so the pseudoholomorphic 
equation for u actually makes sense since T^s is smooth near its image. If 
we consider a lift ^ : M x [0, 1] — > A{T,) of u, then this means that every 
A{s,t) has stabilizer {±1} C GC^), or equivalently dj^(^s,t) is injectivc on 
Jl°(S;su(2)). This lift is not unique, but it always takes values in ^flat(S). 
So for every A = A{s, t) one has the Hodge decomposition (4) 

J]^(S;su(2)) = dAJ^°(S;su(2)) *dAf^°(S;su(2)) h\. 

Here h\ = ker danker d^ = Tfy^jT^s and dAf^'^(S;su(2)) is the tangent space 
of the ^(S)-orbit through A. So one can express dgU + J{u)dtu = in terms 
of the lift: The projection of dgA + *dtA onto h\ = T^y^TZs vanishes; i.e. 
dsA + *dtA = dA^ + *dA* for some ^' : M x [0, 1] ^ J^°(i;;su(2)). More 
precisely, (10) for u mapping to the irreducible representations is equivalent 
to the existence of a lift ^4 : M x [0, 1] A{T,), u{s,t) = [^4(5,^)], and some 
* : M x [0, 1] ^ 0°(S;su(2)) such that 



(11) 



' dsA - dA^ + *{dtA - dA*) = 0, 

*Fa = 0, 
A{s,i)eCHi VsGR,i = 0,l. 



One can also consider this as a boundary value problem for the connection 
$ds + ^dt + ^ on M X [0, 1] X S. Just note that A determines $ and ^ 
uniquely since Aa^ = dAdsA, Aa'^ = dAdtA, and Aa = d^dyi is invertible 
for irreducible A = A{s,t). If A is allowed to become reducible, then $ and 
^ have some extra freedom. If for example ^ = 0, then any two functions 
$,'1' : M X [0, 1] su(2) would provide a solution of (11). Quoticnting 
out by the gauge action, this moduli space is still infinite dimensional. We 
expect however that one can use perturbations of (11) to obtain finite di- 
mensional smooth moduli spaces of trajectories in the cases that are relevant 
for HF|^™^(7^S5 LhqjLhi), i-e. when at least one critical point is irreducible. 
Once this symplectic Floer homology is defined via (11), one should be able 
to adapt the adiabatic limit in [DS] to this boundary value problem and 
establish the following second step towards the Atiyah-Floer conjecture. 

Conjecture 4.4. If Y = Hq Us Hi is a Heegard splitting of a homology 

3-sphere, then there is a natural isomorphism 

HFr*([0, 1] X J:,C„, X jCh,) = B.Ff^P{nj:,CHo,jCH,). 
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Again, the critical points of both Floer theories are naturahy identified. 
In the instanton Floer homology the critical points are fiat connections on 
A + ^dt on [0, 1] X S (where flatness means Fa = and A — d^^^ = 0) 
with boundary values A{0) G Chq and ^(1) € Chi- One can always make 
* vanish by a gauge transformation, then A becomes t-independent, so 
^(0) = A{1) G jC-Ho f"! ^Hi- Thus the gauge equivalence classes of these 
critical points can be identified with intersection points of the Lagrangian 
submanifolds Lhq and Lhi in the moduli space T^s - which are exactly the 
critical points of the symplectic Floer homology. 

In order to identify the moduli spaces of trajectories we can choose an 
appropriate metric on [0, 1] x S in the definition of the instanton Floer 
homology. Let us fix the metric g's on S as in (11) and consider the family 
of metrics dt^ + e^g-£ for £ > 0. With respect to these metrics the trajectory 
equation (9) of the instanton Floer homology becomes 



(12) 



' dsA - dA$ + * {dtA - *dA*) = 0, 
ds^ - dt^ + + *Fa = 0, 
A{s,i)ejCHi Vs G M,i G {0,1}, 



for the triple of ^ : M x [0, 1] ^ A{T.) and ^' : M x [0, 1] ^ 0°(S;5u(2)). 
Their energy 



£{A,^,^f)= [ |0,A-dA$|2 + £-2|FAp 

J]Rx[0,l]xS 



is determined, independently of e, by the index and the limits at ±oo (via 
a monotonicity formula). Analogously to [DS] we expect that sequences of 
such anti-self-dual instantons for £ — >■ converge (modulo gauge) to solutions 
of (11). Now the gauge equivalence classes of these solutions would exactly 
be the trajectories of the symplectic Floer homology. Conversely, an implicit 
function argument should show that for sufficiently small £ > near every 
solution of (11) one finds a solution of (12). This would give the required 
bijection between the trajectories of the symplectic and the instanton Floer 
homology. 

Dostoglou and Salamon indeed dealt with the same equations. However, 
they considered a mapping torus M x E/ (with (t +1,2;) (t, f{z)) 
for some diffeomorphism / of E) instead of our manifold with boundary 
[0, 1] X E, so the boundary conditions in (11) and (12) are replaced by a 
twisting condition. The analytic setup for the definition of the new instan- 
ton Floer homology should also allow to deal with the boundary conditions 
in this context. There are however additional difficulties due to reducible 
connections on the trivial SU(2)-bundle over E, whereas [DS] deals with the 
nontrivial S0(3)-bundle over E that has no reducible connections. 
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5. Lagrangians in the space of connections 

The purpose of this section is to describe some more properties of the La- 
grangian submanifolds in the space of connections that were introduced in 
section 2. We again consider more generally a trivial G-bundle over a Rie- 
mann surface S, where G is any compact Lie group with Lie algebra Q. We 
fix p > 2, then the space of L^'-regular connections A^'^{T,) is a symplectic 
Banach space with symplectic form lo given by (3). The gauge group ^^'^(S) 
acts smoothly on A^'^{Y!t) and preserves oo. Moreover, recall that if we equip 
S with any Riemannian metric, then the corresponding Hodge * operator 
induces an oJ-compatible complex structure on A^'^{T,). 

We have proven in [W2, Theorem 3.1] that an Z^-connection is flat in 
the weak sense iff it is gauge equivalent to a smooth flat connection. So 
for our purposes here we simply define the space of flat L^-connections as 
:= ai'P(S)*>lflat(S) C With this definition it is clear that 

the based holonomy at any 2; G S is well-defined as a map 

hol^:^°f,(S)^Hom(7ri(S),G). 

(Here and in the following one actually has to fix one point z in each con- 
nected component of S.) It is invariant under the based gauge group 

gi'f(E) := {ueg^'P{E)\u{z) = l}. 

Next, we call a Banach submanifold C C A^'^{T,) Lagrangian if is isotropic, 
Lulc = 0, and coisotropic in the sense of the following implication for all 
^ G £ and a G A^'P{^): If a;(a,/3) = for ah /3 G TaC, then a G T^£. The 
main properties of gauge invariant Lagrangian submanifolds are summarized 
below. For proofs sec [W2, Lemma 4.2,4.3]. (In the case G = SU(2) and 
for any other connected, simply concctcd Lie group with discrete center, 
the gauge invariance and Lagrangian property imply that JC lies in the flat 
connections; for general groups we make this additional assumption.) 

Lemma 5.1. Let L C ^°'^(S) he a Lagrangian submanifold. Suppose that 
C C ^gl^^^(S) and that C is invariant under the action o/^^'^(S). Then the 
following holds: 

(i) £ C (v4(S),*) is totally real with respect to the Hodge * operator for 
any metric on S. That is (T,; su{2)) = TajC *TaC for all AeC. 

(ii) Fix any z G S. Then C has the structure of a principal gl'^{Tt) -bundle 

Here M C Hom(7ri(S), G) is a smooth manifold of dimension ^-dim G. 

Property (i) is crucial for the elliptic theory for the boundary value prob- 
lem (8) in the proof of theorem 3.4. Property (ii) gives rise to Banach 
submanifold coordinates for the Lagrangian that fit well with the Hodge 
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decomposition of 0^(S;su(2)). This also is the crucial point that forces us 
to work on I/'-spaces with p>2. One does not have a corresponding state- 
ment for Lagrangians in ^0'2(E) unless one can find a generalization of the 
based gauge group in the VF^'^-regular gauge transformations. This would 
have to be a subgroup that acts freely but has finite codimension. 

Next, we consider the Lagrangians given by handle bodies. For that 
purpose we suppose that G is connected and simply connected and that 
S = dH is the boundary of a handle body H. (Both H and S might have 
several connected components, in which case 'fixing 2; G S' below should be 
replaced by 'fixing a point in each component'.) 

Let Ch be the L^(S)-closure of the set of smooth flat connections on S 
that can be extended to a flat connection on H, 

Ch := c\{A G ^flat(S) I 3i € A^^t{H) : i|s = A] d ^^'^(S). 

Here again the assumption p > 2 is crucial for the subsequent properties. In 
particular, it is not clear whether the L^-closure is a smooth submanifold. 

Lemma 5.2. [W2, Lemma 4.6] 

(i) Ch = {u*{A\j:) \ A e A^^t{H),u e G^'^^)} 

(ii) Ch C A^'^{T,) is a Lagrangian submanifold. 

(iii) Ch C ^^^(S) and Ch is invariant under the action o/^^'^(E). 

(iv) Fix any 2; G S. Then 

CH = {Ae I hol^(^) G Hom(7ri(if),G) C Hom(7ri(S), G)}, 

So Ch obtains the structure of a qI'^{T,) -bundle over the g-fold product 
M = G X ■ ■ ■ X G ^ Hom(7ri(i7), G), 

gl'P{^) ^ Ch '^ilom{7T,{H),G). 

Next, although the Lagrangian Ch does not necessarily have a smooth 
L^-closure, the L^(i;)-norm on Ch can be used to control the corresponding 
fiat connections on H in L'^(H). This extension property is the crucial trick 
that circumvents dealing with the M^^'^-topology on the gauge group. 

Lemma 5.3. There exists a constant Ch such that the following holds. 

(i) For every smooth path A : (— e, e) Ch H A{T,) there exists a path 
A : (— e,e) Aas,t{H) with A{s)\dH = A{s) such that 

(ii) For all Aq,Ai G Ch D A{T,) there exist extensions Aq,Ai G ^flat(-f^) 
with Ai = Ai\QH such that 

(13) ||io - M\l\h) < Ch\\Ao - ^i||l2(e)- 

i°Here we identify Hom(7ri(i/), G) ^ {p € Hom(7ri(S), G) | p{d7r2{H,T,)) = {1}}. 
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The proof in [W4, Lemma 1.6] uses the coordinates in lemma 5.2 (iv). 
Extensions with the correct holonomy can be constructed by hand, and the 
estimates arc immediate on this finite dimensional part. For dealing with the 
gauge transformations the crucial fact is that there is a continuous extension 
operator from W^''^{T,) to W^''^{H). In (i) this fact is used for functions with 
values in 5u(2), whereas (ii) requires the nonlinear version for maps to SU(2). 
The latter is a nontrivial construction of Hardt-Lin [HrL] in this borderline 
Sobolev case (the maps are not automatically continuous). 

6. Rough guide to the analysis 

In this section we give outlines of the proofs of theorems 3.4, 3.5, and 3.7 for 

instantons with Lagrangian boundary conditions. The detailed proofs can 
be found in [W3, W4]. They actually hold for more general domains and 
metrics than considered here, which becomes important when proving the 
metric independence of the Floer homology, and when defining products. We 
study the boundary value problem (8) for SU(2)-connections H G >A(]HI^ x E), 

(14) Fs + *Fh = 0, H|{(,,o)}xS e >Ch VsGM. 

Here iP = {{s,t) gM? \ t > 0} denotes the half space and we equip x S 
with a metric ds^ + dt^ + gs,t, where the metric Qs^t on S varies smoothly 
with [s, t) G W}? and is constant outside of a compact subset. 

6.1. Proof of Compactness. 

For all results in this subsection the Lagrangian Ch in (14) can be re- 
placed by a general gauge invariant Lagrangian submanifold C C A^'^{T?). 
The compactness theorem 3.4 in case (in-L) is a consequence of the fol- 
lowing lemma and theorem. The lemma yields the local L^-bounds that are 
assumed in the theorem. It is based on mean value inequalities and will thus 
be proven later in section 6.2. Here Br{x) C is the closed 2-dimensional 
ball of radius r > centered at .x G M^, and wc denote Dr{x) := Br{x) nM!^ . 
In particular, Dr := Dr{0) C is the closed half ball of radius r. 

Lemma 6.1. [W4, Lemma 2.4] Let ry G v4(BI^ x S) 6e a sequence of anti- 
self-dual connections and suppose that for some xq G H2 andS>0 

sup sup ||F=i'(a:)||^2(s) < 
xeD2s{xo) 

Then for every 2 < p < 3 sup||Fs. \\lp{Ds{xq)xj:) < 

// in fact Bs{xo) H dM = 0, then moreover ^^p\\-^'^'^\\l<^(^Bs{xo)xT,) ^ 

^^The methods will be suitable for generalization to gauge invariant Lagrangians as on 
page 10. The special form of the Lagrangians arising from handle bodies is only used for 
the bound on in lemma 6.4 and for the isoperimetric inequality in proposition 6.6. 
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Theorem 6.2. Let p > 2. Suppose that H*^ G ^(H^ x T.) is a sequence of 
solutions of (14) such that sup^ Hi^si/ ||£p(|f) < oo for every compact subset 
K C M X T,. Then there exists a subsequence (again denoted by ry) and a 
sequence of gauge transformations u'^ G ^(H^ x E) such that u'^ converges 
uniformly with all derivatives on every compact subset o/H^ x S. 

Note that it is crucial to establish this compactness for 2 < p < 3 since the 
previous lemma only provides those curvature bounds near the boundary. 
Next, we outline the steps of the proof in [W3, Theorem B] of theorem 6.2. 
By standard gauge theoretic arguments it boils down to the boundary reg- 
ularity theory in 5b)-f) below. The crucial step is f), where the Lagrangian 
enters as totally real boundary condition for a Cauchy-Riemann equation. 
The case 2 < p < 4 requires a separate treatment described in a') and f). 

1) Reduction to compact domains: By a Donaldson-Kronheimer trick 
[Wl, Prop. 7.6] it suffices to prove the assertion on x S for every k eN. 
Then the gauge transformations on Dj^ x S can be extended to x E and can 
be interpolated with gauge transformations obtained on larger domains. A 
diagonal subsequence then satisfies the claimed C^^^-convergence on x S. 

So we consider a sequence E'^ G .4(H^ x S) of solutions whose curvature 
is in particular L^-bounded on U x S, where U C is some compact 
domain with smooth boundary and -D^ C mt(U). Then we need to find 
gauge transformations and a convergent subsequence on x S. 

In the subsequent steps one frequently gets a new estimate only on a 
smaller domain Ui C mt{h{). (Note that the interior includes points on 
OH^.) However, we can always choose these such that Dj^ C int(Wj). 

2) Weak convergence: We can apply Uhlenbeck's weak compactness the- 
orem 2.1 on W X E. It provides a subsequence (still denoted H'^) and gauge 
transformations u" G G'^^'^iU x E) such that u'' *'ry H°° in the weak W^'^- 
topology with a limit connection G A^'^{U x E). 

3) Regularity for limit solution: The limit E°° now also solves (14). 

For the boundary conditions this is due to the compact Sobolev embedding 
W^'P{U X E) C^{U,LP{T.)). In the nonstandard case 2 < p < A this 
embedding is established in [W3, Lemma 2.5]. 

Now one finds a gauge transformation u G G{Hi x E) such that it*H°° is 
smooth on Ui x E. (This is proven analogously to the iteration in 5), with 
estimates replaced by regularity statements. For the local slice theorem in 

4) it suffices to pick a smooth connection Eq that is I^^'^'-close to S = E°°.) 
One thus finds that {u'^u)*E'^ Eq in the weak I^-'^'^'-topology on Ui x S, 
with a smooth limit Eq = u*E°°. 

4) Relative Coulomb gauge: Next, the local slice theorem 2.2 provides a 
sequence of gauge transformations v'^ G Q{h{i x E) such that still v'^ *E'^ — > Eq 
converges VF^'^*- weakly, and in addition each E = v'^ *E'^ satisfies 



(15) 



d|„(S-So)=0, *(S-So)|awixE = 0. 
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5) Elliptic estimates for (14)&(15): From 2-4) we have a subsequence 
and gauge transformations v'^ such that each S = v'^*'E'' satisfies (14), 

(15) , and ||2|||yi,p(^jxS) ^ for some uniform constant Ci. By iterat- 
ing the following steps a)-f) one next finds uniform constants such that 
ll'='llvK'^.p(W<.xS) ^ Q for alH G N and for ah E = v'^ *E!^. Finally, due to the 
compact Sobolev embeddings W^'P{Df; x S) ^ C^~^{Dk x S) one then finds 
a diagonal subsequence that converges with all derivatives on x S. This 
is what was to be shown according to 1). 

For a)-f) we give the arguments in the case i = 2 and p > 4. This first 
step is considerably harder for 2 < p < 4 and requires a separate iteration, 
which is roughly indicated in a') and f). The iteration for i > 3 and any 
p > 2 then works completely analogous to the arguments below. 

a) Interior estimates: From (14) and (15) we obtain the Hodge Laplacian 

(16) AS = -d*(i[S A H] + i * [S A S]) + ddl^Ho + d * [So A *E]. 

Here the right hand side is bounded in L^, and the leading order of the 
left hand side in local coordinates is the Laplacian on the components of H. 
Thus the elliptic estimate for the Laplace equation yields a W^^'^-bound on 
S in the interior of Ui \ dM.'^. 

Going through the arguments up to this point also proves theorem 3.4 in 
the instanton case (inst) withoTit boundary. 

a') Special iteration for W^ ^-bounds with 2 < p < 4: In this case the 
right hand side of (16) lies in L'^ for some q < p, so one only obtains a VF^'^- 
bound. However, by a Sobolev embedding, this also gives a W^'P'-hound 

for some p' > p. Iteration of a) then yields I^^''?'-bounds for a strictly 
increasing sequence which reaches qn > P after finitely many steps. An 
analogous iteration will work for steps b-f). 

b) Splitting the equation near the boundary: It remains to obtain a 
VF^'P-bound on H near nSH^. For that purpose we rewrite (14) and (15) 
in the splitting S = $ds + ^dt + A (and analogous for the smooth Hq) with 

e W^^P{Ui X S;5u(2)) and A e W^'P{Ui x S, T*S 5u(2)), 

{dsA - dA^) + *{dtA - dA^') = 0, 
d^-^ - dt^ + ^ + *Fa = 0, 

(17) \ V,($ - $o) + Vt(* - ^^o) - d:^„(^ - ^o) = 0, 

(*-*o)|t=o = 0, 

A{s,0)eC VsgR. 

Here wc use the notation Vs = ds + [^O: '] and Vt = dt + [^'o, ■]• 

c) Estimates for ^: From (16) we know that A^* is L*'-bounded. In 
addition, we have the inhomogeneous Dirichlet condition ^'|t=o = ^'o|t=o- 
Thus the elliptic estimate for the Dirichlet boundary value problem implies 
a W^^'^-bound on up to the boundary. 
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d) Estimates for Again, A$ is L^-bounded due to (16). Moreover, we 
have an inhomogeneous Neumann condition dt^\t=o = {Og^o + [^5*o])|t=o 
since the Lagrangian boundary condition with C C ^g^(E) in particular 
impHes FA\t=o = 0. Then the ehiptic estimate for the Neumann boundary 
value problem (e.g. [Wl, Theorem 3.2]) provides a M^^'^-bound on 

e) Estimates for Vs A: We can now rewrite (17) to express the differential 
and codifferential of A{s,t) G 0-^(S;su(2)) for every {s,t) G Wi as 

*ds^ = -^*[AaA]- ds^ + dt^ - [$, 

d^A = Vs($ - $o) + Vt(^' - *o) + *[^o A *A] - d\Ao. 

Due to the previously established bounds on $ and ^ the right hand sides are 
bounded in W^'P{U2 x E), that is in W^'P{U2, LP{T,)) and U'{U2,W^'P{^)). 
Now the elliptic estimates from the Hodge decomposition for each (s, t) G U2 
can be integrated to give bounds on Vs^ in the same spaces, and hence a 
W^'^-bound. For a detailed statement and proof see [W3, Lemma 2.9]. 

f) Estimates for dsA,dtA: So far A is bounded in U'{U2,W^'P{^)) and 
W^'P{U2, W^'^CE)). To achieve a VF^'^-bound it remains to find an estimate 
in W'^'P(U2,LPi'S)), that is on dgA and dfA. At this point, the full La- 
grangian boundary condition needs to be used. Up to now, we only used its 
local part, the slice-wise flatness. The additional holonomy conditions are 
of global type (requiring knowledge of the connection on loops in E), so this 
information is lost when one localizes, i.e. goes to a coordinate chart in E. 

The solution is to consider A as map from Ui to the Banach space ^'^'^(E). 
This is a complex space when equipped with the Hodge * operator. So we 
can rewrite (17) and recall lemma 5.1 (i) to see that A satisfies a Cauchy- 
Riemann equation with totally real boundary conditions: 

(18) dsA + *dtA = dA^ + *dA^, A{s,0) e C Vs G M. 

Now one basically has to go through the proof of theorem 3.4 for the holo- 
morphic curves in case (symp) with the extra difficulty that the target space 
is infinite dimensional. This would be fairly standard for a Hilbert space. 
However, the iteration only works for p > 2 and we also need to work with 
p > 2 to make sure that the Lagrangians arc smooth submanifolds. 

Here we use the general theory in [W2] for maps to a complex Ba- 
nach space X. The crucial assumption is that X is a closed subspace of 
an L^-space for some 1 < p < 00 on a closed manifold (for example X = 
A^'P{T,)). Then the elliptic L^-estimates (with the same Sobolev expo- 
nent as in X) hold for the Dirichlet and Neumann problem. One can then 
use the usual argument for the Cauchy-Riemann equation with totally real 
boundary conditions: In a submanifold chart the components of the map 
M : W — > T^zqC X TzqC = X satisfy Dirichlet and Neumann boundary con- 
ditions - at the expense of the complex structure becoming u-dependent. 
Prom an iT'-bound on {dg + df)u one then obtains a VF^'^-estimate on u. 
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Due to the nonlinearity in the complex structure however, the L^-estimate 
on {dg + df)u requires T^^'^^-bounds on u and dgU + JdtU. 

In (18) the right hand side is bounded in W^'^(Zi, L^(E)) due to the pre- 
vious bounds on $ and ^' (on some domain U C int(Wi) with U2 C mt{U)). 
By the above discussion we now have to write p = 2p' and we only obtain 
W2,P'.estimates for A:U ^ X = A^'P' {E) with dsA + *dtA e W^''^p'{U, X). 
So this last step yields a bound on S in W'^'^{U2 X S). For p > 4 we still 
have I > 2 and the further iteration yields VF^'2-bounds for all £ G N. 
f ') Special case 2 < p < 4 for W^'P-bounds: In this case we only have 
q < p in the W^''^- and VF^'^-bounds on ^, and Vs^ from c)-e). So the 
right hand side in (18) is of even lower regularity that will not fit in the 
above arguments. However, it is bounded in {U , (T,)) for some r > p. 
So one can use the submanifold charts for £ C ^°'^'(S) to write A as a map 
u : U ^ Tao^ X T^Ao^i where Taq^ C ^^'^(S) is a closed subspace. The 
two components of u then satisfy weak Dirichlet and Neumann equations 
with the weak Laplacian in W~^'^(U,LP{T,)). The previous general theory 
unfortunately only works when we replace the r > phy p and it would then 
give a bound on u in W^'^{U2, L'P{T,)), which is what we started out with. 
However, one can use all the usual elliptic estimates when the target is a 
Hilbert space. So we consider u as map into .4°'^(S) x A^'^{T,) with a W~^''^- 
bound on its weak Laplacian. This yields a W^''^{U2, L^(S))-bound on u with 
r > p. The previous bounds in e) moreover imply a II^^'''(Z//2) -^''(S))-bound 
on u, where q < p but s > p since it results from the Sobolev embedding 
I^^'5(S) ^ L^C^)- Now these two bounds can be interpolated to obtain a 
W^'^ {U2 X S)-bound with p' > p. This bound on u also translates into a 
W^'P -bound on A, which fits into the same iteration as in a'). 

6.2. Mean value inequalities. 

The proof of theorems 3.5 and 3.7 as well as lemma 6.1 makes use of 
some mean value inequalities which we summarize here. These are based 
on a generalization of the mean value inequality for subharmonic functions. 
Here we state it for the Euclidean half space H". In the interior case this is 
wellknown for general metrics. In the case of balls intersecting the boundary 
this was proven in [W5, Theorem 1.3] for the Euclidean metric. 

Proposition 6.3. For every n > 2 there exists a constant C and for all 
a,b>0 there exists h{a, b) > such that the following holds: 

Let Dr{y) C be the partial ball of radius r > and centre y G EI"'. 
Suppose that e G C^{Dr{y), [0,oo)) satisfies for some constants A,B>0 




and 




Then e{y) < + + r"") /j 



Driy) 



e. 
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For all three types of Floer theory that are discussed in section 3, the 
energy densities satisfy the differential inequalities for proposition 6.3 with 
exactly the critical nonlinearities. These estimates are summarized below. 

Lemma 6.4. Consider a solution of the trajeetory equation (T) in defini- 
tion 3.2. Its energy density e satisfies the following nonlinear hounds on Ae 

and -^e with constants a, b, C. 

(inst): e = \dsB\'^ : M x y ^ [0, oo) satisfies Ae < C e + a ei . 
(in-L,interior): e = \dsA\^ + \Fa\^ : M x [0, 1] x E ^ [0, oo) satisfies 

3 

Ae < Ce + ae2. 

(in-L,boundary): e = ||5sA|||2(s) + ||-Pa|||2(s) : Mx[0, 1] [0, oo) satisfies 

Ae<C(l + ||FA|Uco(s))e, |-e<Ce + 6ei. 
(symp): e = \dsu\'^ : M x [0, 1] — > [0, oo) satisfies 

Ae<ae^, ^e<6ei. 

Indications of proofs of lemma 6.4: 

For the holomorphic curves in case (symp) one picks up linear terms in 
the estimates if the almost complex structure J varies over the domain. 
The bound on the Laplacian can be found in e.g. [MS2, Lemma 4.3.1]. 
The bound on the normal derivative was wellknown and is proven in [W5, 
Lemma A.l] using Darboux-Weinstein coordinates near the Lagrangian. 

For the anti-self-dual instantons in case (inst) this estimate is a direct 
consequence of a Bochner-Weitzenbock formula, see e.g. [W5, Lemma A. 2]. 
It was used by Uhlenbeck [Ul, Lemma 3.1] in a slightly different formulation. 
For the anti-self-dual instantons with Lagrangian boundary conditions, one 
has the same bound on the Laplacian, as stated in (in-L, interior). However, 
this only provides estimates in the interior (on balls that do not intersect 
the boundary) since one does not have a bound on the normal derivative. 

In view of the global methods in section 6.1 f) that were necessary for the 
proof of the basic compactness theorem 3.4 it should not be surprising that 

f) 5 

we were not able to obtain any bound on in terms of e, let alone by 6 ei . 
It is highly unclear how the (nonlocal) holonomy part of the Lagrangian 
boundary condition should be utilised for such a local estimate. On the 
other hand, there are examples showing that such an estimate cannot follow 
only from the (local) flatness part of the Lagrangian boundary condition. 

Thus it seems natural that the full Lagrangian boundary condition is only 
captured by the 2-dimensional energy density given in (in-L, boundary). In- 
deed, we obtain the same bound on the normal derivative as in case (symp). 
The proof in [W4, Lemma 2.3] works as follows: A simple calculation using 
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the trajectory equation (T) in definition 3.2 (that is (14) in temporal gauge) 
gives the normal derivative at the t = boundary component: 

< [c\\dsA\\l,^^^+ ljdsAAd',A))l^^. 

Recall that e = ||5s^||^2(j]') + ||-^a||^2(5^) and -Fyi|^^Q = by the boundary 
condition. So the first term on the right hand side is just Ce for a constant C. 
The crucial second term is u{dsA, dgA) for a path A : {—£, e) — jCh in the 
Lagrangian and with the symplectic form (3). 

This term would vanish if the Lagrangian was straight - as in Darboux- 
Weinstein coordinates. Otherwise the curvature of the Lagrangian leads 
to a cubic term. For general infinite dimensional Lagrangians the curva- 
ture might not be suitably bounded, and it is not clear whether Darboux- 
Weinstein coordinates even exist. Fortunately, we are dealing with La- 
grangians that are compact modulo gauge transformations. A proof along 
this line would require a subtle linear estimate for gauge transformations 
in the critical Sobolev space VF^'^(S), which has not been carried out yet. 
For the special Lagrangian Ch arising from a handle body we can use the 
following trick based on the extension property in lemma 5.3 (i). 

We have A{s) = A{s)\i)h for a path of extensions A : (— e,e) Aiia,t{H) 
such that ||(?sA||2,3(/^) < C||3sA||^2(-s). Now Stokes' theorem gives 

[ {dsAA 5^1 ) = / ( djd.A Ad^A) - I { dsA A d^dlA ) 
JT, Jh Jh 

= [ {dsAA[dsAAdsA]) 

Jh 

<lMlli3(^) <C^dsA\\l,^^^ =cM. 

Here we used the fact that = 0, hence d^dgA = dgF^ = 0, and moreover 
= d'^Fj^ = dj^d'^A + [dsA A dsA]. This proves de/di^ < Ce + he^l'^. 

The price for going to the more global energy density in (in-L, boundary) 
has to be paid when considering the Laplacian. The straight forward calcu- 
lations in [W4, Lemma 2.3] yield 

The first term is just Ce. The second term should also be bounded in terms 

of the L^-norms of the curvature components dgA and Fa- However, the 
best bound that we can find is ||Fyi||j^oo(-2)||9sA||^2(s) — II-^aIIl°°{S)C- Here 
we use the L°°-norm on Fa since this has better analytic properties, in par- 
ticular Dirichlet boundary conditions FA\t=o = 0, whereas dgA only satisfies 
Lagrangian boundary conditions (of global type). This will be crucial in 
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the proof of the energy quantization theorem 3.5, where we wih find that 
Ae < C(l + ||F^||£oo(s))e is essentially bounded by Ce^. 

Proof of lemma 6.1: This is a consequence of the mean value inequality in 
proposition 6.3 applied to the energy densities = ISs^'^p + lF^p = llFs^P 
from case (in-L,interior) of lemma 6.4. The assumption can be read as 

(19) J e^{x, ■) <K for all x G D25{xq) 

with some uniform constant K. On 4-dimcnsional balls Bf{y) that are 
entirely contained in D2s{xo) x S this implies f^^^y) — T^Ke^ . Now there 
is a maximal radius Sq G (0, 5) such that for all e < eo this energy is less 
than h(a) and thus one has the mean value inequality 

(20) e^y) < C(l + e-^)7rKe^ 

In the interior case, one fixes a radius < e < £o less than the distance 
d\s\,{Bs{xQ),dM?) > 0. Then all balls Bf{y) for y G Bs{xo) x S are contained 
in D2s{xo) X E and (20) is the claimed uniform bound. 

In the boundary case xq = (sq, ^o) with to < 6 one cannot use a fixed ra- 
dius for the balls near the boundary. At y = (s, t, z) G Ds{xq) x S the max- 
imal ball that is entirely contained in D2s{xo) x S has radius e = mm(t,5). 
So for all {s,t,z) G Ds{xo) X E with < t < £o the mean value inequality 
(20) gives 

eu{s,t,z) < C'{t^ + t-'^). 

Away from the boundary, for t > Eq, this also holds with some modified 
constant C by (20) with a fixed radius. Now this bound blows up as t ^ 0, 
but it can be interpolated with (19) to give an L^'-bound on l-Fsi-l = (e,/)"^/^ 
by the following integral which is finite for 2 < p < 3. 

/ (e.)§ < / (C'(t2+t-2))f-i A < c"(l+ r^\^-Pdt). 

Jds{xo)xt. Jds(xo) Je ^ Jo ^ 

6.3. Proof of Energy Quantization. 

The proof of theorem 3.5 for anti-self-dual instantons without boundary 
and for the holomorphic curves is a direct consequence of the mean value 
inequality in proposition 6.3 applied to the energy densities in lemma 6.4. 
(See [W5, Theorem 2.1] for this general energy quantization principle.) For 
(inst) and the interior of (in-L) this is the simplest version of the argument 
- on balls with no boundary condition in dimension n = 4. Here we give 
the argument for the holomorphic curves in (symp), more generally for a 
sequence of energy density functions Cj : M x [0, 1] — > [0, cxd) satisfying 
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We need to prove that if the energy densities blow up at some x G M x [0, 1], 

(21) sup sup Ci = oo V(5 > 0, 

i Ds{x) 

then (for a subsequence) a fixed energy quantum h> concentrates there, 

(22) / Ci > h V(5 > 0. 

JDs{x) 

The same needs to be proven in case (in-L) for boundary points x. For 
these anti-sclf-dual instantons with Lagrangian boundary conditions we use 
the energy density ej = ||5s74j|||2(s) + ll-^-Ai Ili2(s) ™ (in-L,boundary) of 
lemma 6.4. So the constant K above is replaced by the unbounded function 
C{1 + Il^oo(s)). Moreover, the assertion (22) in this case implies the 
concentration of energy near {x} x S C M x [0, 1] x S. 

So let us assume (21). Then we find a subsequence and points Xi x 
such that ei{xi) = blows up with a certain rate Ri ^ oo. We will now 

try to apply proposition 6.3 on the balls Dsi{xi) of radius Si := R^^^^ > 0. 
For that purpose we need to assume that ^^.^ e-i <h = h{a, b). If that is 
the case then we obtain the mean value inequality 

•JBs.{xi) 

Multiplication by R^^ = SfR^^ then implies 

1 < Ch{KRf + B'^Rf + R-r^). 

First assume that K is constant. Then the right hand side converges to 0. 
Thus the assumption must have failed for all sufficiently large i G N, that is 
Ins-ix ) ^ ^' This implies the energy concentration (22). 

If K is not a constant, then this argument still works as long as K < C'RJ. 
In that case the limit i — > oo implies 1 < CC'h. If one chooses h < {2CC')~^, 
then this gives a contradiction and thus proves the energy concentration. 

So for anti-self-dual instantons with Lagrangian boundary conditions in 
case (in-L) we have to prove that if = i?? blows up, then the functions 
K = C(l -I- ||£,oo(s)) are bounded by C'Rf. This statement is slightly 
weaker than a direct bound ||-Fyi||L°°(E) ^ C'H-^H 11^2(2) ~ would be, but 
it still shows that Ae < C(l + ||F^||/^oo(5]))e is essentially bounded by Ce^. 

By using the Hofer trick [HZ, 6.4 Lemma 5] within the previous argument 
one can additionally control by the blowup rate on small neighbourhoods. 
One then needs to establish the following as in [W4, Proposition 2.7]. 
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Lemma 6.5. (Crucial Estimate): Let Hj = ^ids + ^idt + Ai G A{lf x S) 
be a sequence of solutions of (14:). Consider a sequence of blowup points 

9 Xj — > with the blowup speed Ri oo. Assume an L?'{Ti)- control on 
the full curvature on (partial) balls of radius 2ei such that SiRi — > oo, 

\\Fs,i^,-)\\LH^)<Ri \/x€D2eM)- 

Then one obtains an L°° -control on the curvature component 

•)IIloo(e) < CR^ Vx G De,{xi). 

The proof combines all previous techniques to a subtle contradiction. This 
is what remains of the usual energy quantization proof via local rescaling: 

1. ) Assume the contrary: Then one finds sequences of solutions S,, points 
{xi, Zi) (0, z) G X E, and Ri — >■ oo, — > 0, Q — oo with SiRi oo, 

^^PxeD.^ixi) II^Hi(a;,-)llL2(s) < Ri, \FAiixi,Zi)\ > {CiRif. 

2. ) Local rescaling: The crucial case is when Xi = {si,ti) converges to 

so fast that even tiRiCi — >■ 0. So for simplicity wc assume here that 
Xi G dM?. Then we can restrict Sj to half balls of radius 5i := {CiRi)~^ < Ei 
and rescale them to connections := 'Ei{{xi,Zi) + 5iy) on the half ball 

C of radius 1 centered at 0. The rescaled connections then satisfy 

(23) \F^^m > 1. 

3. ) LP-decay of for p < 3: By a calculation similar to lemma 6.1 for 
the curvature of the rescaled connections one obtains for all 2 < p < 3 

(24) WFeJlinD^) ^ 0- 

4. ) C°-estimates for in terms of LP-bounds on F^ for p > |: 

From (24) for p > 2 and Uhlenbeck's weak compactness theorem 2.1 we 
know that (up to gauge and taking a subsequence) the rescaled connections 
Hj G A{D^) converge to a flat connection in the weak Tl^^'^-topology. One 
obtains stronger estimates from the fact that the rescaling preserves the 
anti-self-duality equation. This implies C°°-convcrgcnce of the Hj away from 
the boundary dW^. At the boundary, the local rescaling has lost the global 
part of the Lagrangian boundary condition, but the slice-wise flatness per- 
sists, -Fc. |{(s,o)}xM2 = 0- With this one can go through the steps b)-e) in 
section 6.1 to obtain W^'^-estimates on some components of the Sj. One 
then feeds these back into c) and d) to obtain W^'^-bounds on V^i and V*i, 
where the derivative V is only in the M^-directions corresponding to TE. 

Now we need to assume (24) with p > |, then we can work with q > 2 
and the above bounds are just strong enough to imply C°-convergence of the 
curvature part *F^ = dt^ — + Since this convergence is to a flat 

connection, it provides a contradiction to (23). Note that this contradiction 

between 3) and 4) crucially relies on the celebrated fact I < 3 
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6.4. Proof of Removability of Singularities. 

The proof of theorem 3.7 in case (in-L,boundary) proceeds through the 

subsequent three propositions. Throughout wc denote by Dj- := l?r(0) C 
the half ball of radius r > 0, by D* := Dr \ {0} the punctured half ball, and 
we will use polar coordinates (r, (f)) G with r G (0, 1] and G [0, vr]. 

We will consider solutions of (14) on Dl x S, that is anti-self-dual con- 
nections which satisfy the Lagrangian boundary condition on {(s,0)} x S 
for s ^ 0. An important tool for a connection H G A{D1 x S) with finite 
energy /^t^s l-^sP < oo is its energy function £ : (0, 1] —>■ [0, oo) given by 

The above calculation shows that finite energy directly implies £{d) as 
S ^ 0. For a finite energy solution of (14) one thus obtains mean value 
inequalities as in section 6.2 on sufficiently small punctured balls. 

Proposition 6.6. [W4, Lemma 5.4] There are constants C and e > such 
that the following holds. Let S G A{Dl x S) be a solution of (^14 ) and suppose 
that £{2r) < e for some r G (0, ^]. Then for all (p G [0, tt] 

(i) ||FH(r,</.)||i2(2) <Cr-iV^, 

(ii) ||FH(r,0)||i^(s) < C(rsin0)-2 7^ . 

Sketch of Proof: The estimate (ii) is the mean value inequality for e = |-FsP 
that follows from proposition 6.3. Since lemma 6.4 does not provide a con- 
trol on -^e we can only work on balls that are entirely contained in ^ ^• 
When centered at (r, (j), z) G D"^ x S, their maximal radius is rsmcj). 

Next, write the connection as S = $ds -|- ^dt + A. For the curvature 
component F^, which vanishes at the boundary G {0, vr}, we can improve 
(ii) to ||FA(r-,^)||L-(s) < Cr-'^. This follows from ||Fs(r, (/')||i,2(s) < Cr'^ 
similar to lemma 6.5 (||-^yi||L°o(s) is essentially bounded by ||-Fh||£,2(5]))- '^^^ 
latter estimate is proven by an indirect argument as in section 6.3. This uses 
the mean value inequality for e = ||-^e:||^2(j^) from proposition 6.3, based on 
lemma 6.4 and again lemma 6.5. 

Once ||F^(r, 0) ||l^(s) — Cr~'^ is established that way, one can use it again 
in the mean value inequality for e = ||-Fh|||2(-2)- provides Ae < Cr^^e on 
(partial) balls of radius |r around (r, (p). The claim (i) then follows directly. 

The curvature decay established here is almost sufficient to remove the 
singularity. The exponent of r only has to be slightly improved to achieve the 
conditions in the following removable singularity result. This improvement 
will finally be achieved in the crucial proposition 6.8 by a control on the 
speed of convergence of the energy function £{r) ^ as r ^ 0. 



= lim 

5^0 



= \im{£{r)-£{5)). 
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Proposition 6.7. [W4, Theorem 5.3] Let E G A{Dl x S) and suppose that 
for some constants C and /? > and for all (r, 0) G Dl 

(i) ||Fs(r,0)|U2(s) <Cr^-^ 

(ii) ||Fs(r,0)|Uoc(s) <C(sin^)-V-2 . 

Then there exists p = p{f3) > 2 and a gauge transformation u G Q^'P{Dl x S) 

SMc/i that u*'E extends to a connection H G ^-^'^(Di x E). 

Moreover, if 3 is a solution of (14 ), then H automatic-ally solves (14 ) on 
Dl xTi. A further gauge tranformation then makes H G A{Di x S) smooth. 

Sketch of Proof: To control the connection in terms of its curvature we 
fix a special gauge: Trivializing the bundle along rays < r < 1 for fixed 
(t>= ^ and z G S and then along < ^ < tt for fixed r and 2; G S we obtain 

S = ^ + i?dr + Od(/> with = 0. 

Here A : D*^ ^ Jl^(S;su(2)) and R : ^ f^°(S;su(2)). In this gauge we 
have Ic^r^ll^-i ^ and I^^Hl < r|Fs| since the curvature decomposes as 

m'' = \FAf + \drA - dARf + r-'^ld^Rf + r-^\d^Af. 

The bounds (i) and (h) combine to G LP{Di x S) for some p > 2 that 
only depends on /3. Roughly, they also imply 'E\{(r,^)}x'E — ^0 G >A°'^(I1) 
and H||r}x[o,7r]xS ^ ^0 G C^{[0,7r], A^'^^E)) as r ^ 0, and ^0 provides the 
extension over {0} x E. In practice one constructs a family of connections 
{Ei;)i;>o on Dl X S that coincide with S outside of x S and equal to 
A{e, ^) on x S. Using (i) and (ii) this cutoff construction can be done 
such that ll^s^ — -FhIIlp(DixS) ^ as e ^ 0. 

By Uhlenbeck's compactness theorem 2.1 one then finds a sequence £j — > 
and gauge transformations Uj G G{Di x E) such that u*Es^ converges W^''^- 
weakly to a limit connection S G A^'^{Di x E). Note that on every compact 
subset of X E the sequence S^- eventually coincides with H. So the above 
convergence also implies that (for a subsequence) the gauge transformations 
Ui converge to a limit u G Gi^^{Dl x E) in the weak I^^'^'-topology on every 
compact set. Then by the uniqueness of the limit u*E = S|d*xe, so E is 
the claimed extension. If moreover H and hence H arc solutions of (14) then 
the regularity theorem [W3, Theorem A] for this boundary value problem 
asserts that S is gauge equivalent to a smooth solution. 

Proposition 6.8. [W4, Lemma 4.1] Let E G A{Dl x Y,) be a solution of 
(14) with finite energy £{1) < 00. Then for all r G (0, 1] 



£{r) < r^£{l). 
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Sketch of Proof: By the anti-self-duaUty equation *F-^ = —F-^ we have 

hf {FsA*Fs) = U d(SA(Fs-i[SAS])). 

J{DrQ\Ds)x-E J{Dro\Ds)x-S 

This converges to f (ro) as (5 ^ 0. On the other hand, Stokes' theorem 

expresses this as integral over d{DrQ \ Ds) x S. Our goal is to rewrite it as 
J^{As)—T{Ar„) for a functional depending on A' := A{r,-) : [0, tt] —>■ 
Here as in proposition 6.7 we work in the special gauge E = A + Rdr. Then 
proposition 6.6 (i) gives 1^2(2) < C^/£{2r) ^ as r ^ 0, so the paths 

Ar are L^-short paths connecting Ar{0), Ar{7r) £ Ch- These contribute to 
on the boundary components {ro} x [0, tt] x S and {5} x [0, vr] x S. So it 
remains to deal with the boundary components'^ at (?!) = and = tt. 
We identify these with ([— tq,— (5] U [(^, r-o]) x S and glue in the domain 
([~''0)~'^] U [5, To]) X H. Now extending the families Ar{0), Ar{'K) £ Ch 
by (0) , (ti") £ Aiia,t{H) preserves the value of /( F^; A Fs ), and 

(25) £{ro) = CS{As,A5)-CS{Ar„,Ar„). 

Here we introduce the Chern-Simons functional for a path A : [0, vr] AiT,) 
with L^-close ends A{<d),A{'K) G Ch and extensions A{<d)^A{-K) e Afiat(-ff), 



CS{A,A) = -\ r f {AAd^A) + ^\f d(i(</.)A[i(</.)Ai(0)]) 

= -1 r r / {d<i>Aie)Ad^Ai(l)))d9d(l> 
Jo Jo Jt, 

-i-J { [(i(0) - i(7r)) A (i(0) - i(vr))] A (i(0) - i(vr)) 



0=0 



IH 

This magic identity together with the special choice of extensions as in 
lemma 5.3 (ii) allow us to obtain the isoperimetric inequality 

2 



\CS{Ar,Ar)\<\(^j^ ||a^A|L2(s)d<^) +n(Pr(0)-A(7r)||^3(y)) 



lL2(S) 
|2 



2 

d(^' 



For sufficiently short A^ this implies |C»S(Ar5 ^r-)| < ti" /o^||^</>^r||^2(s)- -A-S 
seen before this converges to as r = (5 ^ 0, and moreover it is bounded 
TTr£{r). So (25) provides the differential inequality 8{r) < Trr£(r). Integrat- 
ing ^ln<5(r) > (vrr)^^ then proves the claimed decay of £{r). 

^•^Onc could eliminate these by gluing in paths A,. : [0, tt] Ch in the Lagrangian con- 
necting AriQ), Arlir) € Ch- This would reach the goal with a functional T = ^{Ar, A'^). 
For the subsequent argument however, the L^-length of the path A'^ has to be controlled 
by the L^-distance of its endpoints. The crucial point would be to establish this fact for 
paths in a fixed gauge orbit - a subtle nonlinear ly^'^-estimate for gauge transformations. 
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